Mixed Method Data

COMPARISON CHARTS.# Points of

difference N. Article R. Article Proposal M. Thesis P. Thesis

1 Definition

A news article is an article published in a print or Internet news medium such as a newspaper, newsletter, news magazine, news-oriented website, or article directory that discusses current or recent news of either general interest (i.e. daily newspapers) or on a specific topic (i.e. political or trade news magazines, club newsletters, or technology news websites).

is an academic article published in an academic journal. The status of academics is often dependent both on how many articles they have had published and on the number of times that their articles are cited by authors of other articles.

A proposal is a written document from a researcher for the board or supervisor proposing a future research with rationale of the contents for approval to work on.

A proposition that is maintained by argument. A dissertation advancing an original point of view as a result of research, especially as a requirement for an academic degree.

A dissertation advancing an original point of view as a result of research,

1 Purpose Publish in news article Publish in Journal propose a research study for approval

A thesis is a document written in support of obtaining an academic degree or qualification. It is usually longer than research paper and thus completed in a number of years.

Research study for doctorate degreeit performs three main functions:• It begins to put forth your ideas. • It foreshadows your arguments. • It attracts a reader's attention.

2 Scope Very broad Limited to related field limited to supervisor or board Limited to the boardLimited to the board but later can be broadened by deriving articles from it

3 Readers General PublicPeople in related field, Policy makers, strategy makers, Executives, Trainers, Researchers, students etc

Supervisors and board Supervisors, and board people, students, researchers

Supervisors and board people, students, researchers

4 wording easy and general easy yet in specific terms of related field

easy yet in specific terms of related field



5 Tone interest oriented awaring, sharing, explianing and concluding

convincing with rationality and reasons convincing and argumentative argumentative, proving, and

generating theories

6 Contents based on one Hot issues, with no or limited contents

Introduction, literature, Methodology, analysis results discussion and conclusion

Introduction, literature, Methodology, significance, purpose, theoretical framework

Introduction, literature, significance, purpose, objectives, R. Questions/ hypothesis, theoretical framework, Methodology, analysis results discussion and conclusion

Introduction, literature, significance, purpose, objectives, R. Questions/ hypothesis, theoretical framework, Methodology, analysis results discussion and conclusion

7 Authenticity Not so authentic w.r.t. research Highest authenticity a mediating document Highest authenticity Highest authenticity

8 Report formation A short report of few pages is prepared.

A short document of few pages is prepared.

A detailed report is prepared in the form of booklet.

A detailed report is prepared in the form of booklet.

MIXED METHODS Lecture # 5

Mixed Method is a philosophical assumption based on pragmatic grounds that integrates quantitative and qualitative research approaches within a single project.

It is also called “Multitrait, Mulitimethod, integrated or combined”

Mixed method

A Multi-method designs Mixed methods designs

Use more than one method but restricted to methods selected from within one worldview (i.e. quantitative or qualitative approaches).Types:Multi-method quantitative studiesMulti-method qualitative studies

Use and mix both qualitative and quantitative data and methods.

Types: Mixed method studiesMixed model studies.

Note: mixed methods ≠ multi methods

Merge the data:

connect the data:

Embed the data

Mixing the data

Qualitative dataQualitative data ResultsResults Quantitative dataQuantitative data

Qualitative dataQualitative data Quantitative dataQuantitative data ResultsResults

Quantitative data Quantitative data

ResultsResultsQualitative data

It offset the weaknesses of both quantitative and qualitative research by providing comprehensive evidence as being “practical” in the sense that the researcher is free to use all methods possible to address a research problem.

The central principle of Mixed Method Study

Types/Approaches of Mixed Method Study

TriangulationDesign

Embedded Design

ExploratoryDesign

Explanatory

Design

Convergence Model

Data tranformation

Model

Validating quantitative

Model

Multilevel Model

Experimental Model

Correlational Model

Follow-upexplanation

Participant selection

Model

Instrument development

model

Taxonomy development

model

1.The Triangulation Design

Variants of the Triangulation Design

Convergence Model data transformation Model Validating quantitative model Multilevel Research

Major Types (Approaches) of Mixed Method Design

QUAN QUAL

Interpretation based on

QUAN + QUAL results

Convergence Model

Cont….

QUAN

Data

Collection

QUAN

Data

Analysis

QUAN

Results

QUAL

Data

Collection

QUAL

Data

Analysis

QUAL

Results

Compare

&

Contras

Interpretation

QUAN + QUAL

Data transformation Model

QUAN

Data

Collection

QUAN data analysis

QUAL

Data

Collection

QUAL

Data

Analysis

Transform QUAL

into quan data

Compare &

Interrelate

Two QUAN data sets

Interpretation

QUAN + QUAL

Cont….

Validating quantitative Data

QUAN data

Collection:

Survey

QUAN

Data

Analysis

QUAN

Results

Qual data Collection:

Open ended

Survey items

Qual

data

Analysis

Qual

Results

Validate QUAN

results with qual results

Interpretation

QUAN + QUAL

Cont….

Multilevel Research

Level 1:

QUAN

Data collection, analysis, resultsLevel 2:

QUAL

Data collection, analysis, results

Level 3:

QUAN

Data collection, analysis, results

Overall

Interpretation

Cont….

2.The Embedded Design

or


Experimental ModelCorrelational Model

QUAN

qual

Interpretation

Based on

QUAN (qual)

results

QUAL

quan

Interpretation

Based on

QUAL (quan)

results

Cont….

Experimental Model

qual

Before

Intervention

QUAN

premeasure

QUAN

post measure

Qual

after

Intervention

Qual

During

intervention

Interpretation based on QUAN(qual)

results

Cont….

Correlational Model

Qual process

Interpretation

Based on

QUAN (qual)

results

QUAN

Pridictors

QUAN

Pridictors

QUAN

Pridictors

QUAN

outcome

Cont….

3.The Explanatory Design


The follow-up explanationsThe participant selection model

QUAN Qual

Interpretation based

QUAN Qual

results

Cont….

The follow-up explanations

QUAN

Data collection

QUAN

Data analysis

QUAN

Results

Identify results

for follow-up

Qual

Data collection

Qual

Data analysis

Qual

results

Interpretation

QUAN qual

Cont….

The participant selection model

quan

Data collectio

n

quan

Data analysis

quan

Results

QUAL participa

nt selection

QUAL Data

collection

QUAL Data

analysis

QUAL results

Interpretation

quan QUAL

Cont….

4.The Exploratory Design


The instrument development model Taxonomy development model

QUAL quan

Interpretation based

QUAL quan

results

Cont….

The instrument development model

Cont….

qual

Data collection

qual

Data analysis

qual

Results

Develop instrumen

t

QUAN Data

collection

QUAN Data

analysis

QUAN results

Interpretation

quan QUAN

Taxonomy development model

Cont….

QUAL Data collection

QUAL Data analysis

QUAL Results

Develop taxonomy or theory

for testing

Quan Data collection

Quan Data analysis

Quan results

Interpretation

QUAN Qual

The major mixed method design types

Design Type Variants Timing Weighting Mixing Notation

Triangulation

Convergence Data transformation Validating

quantitative data multilevel

Concurrent: quantitative and qualitative at same time

Usually equal Merge the data during the interpretation or analysis

QUAN + QUAL

Embedded embedded

experimental embedded

correlational

Concurrent or sequential

Unequal Embed one type of data within a larger design using the other type of data

QUAN(qual) OR QUAL(quan)

Explanatory follow-up explanation participant selection

Sequential: quantitative followed by qualitative

Usually quantitative

Connect the data between the two phases

QUAN qual

Exploratory instrument development

taxonomy development

Sequential: qualitative followed by quantitative

Usually qualitative

Connect the data between the two phases

QUAL quan

Data Collection in Mixed Methods Research Phases in the Data Collection Process for Qualitative and Quantitative Research

Qualitative Data Collection Phases in the process of Research

Quantitative Data Collection

Purposeful sampling strategies small number of participants and

sitesSampling Procedures

random sampling adequate size to reduce sampling

error and provide sufficient power

from individual providing access to sites

institutional review boards individuals

Permissions needed from individual providing access to

sites individual review boards individuals

open-ended interviews open-ended observations documents audiovisual materials

Information to be collected

instruments checklist public document

interview protocols observational protocols

Recording the data instrument with scores that are reliable and valid

attending to field issues attending to ethical issues Administering data

collection

standardization of procedures attending to ethical issues

The data collection procedures will vary depending on the type of mixed method design. In mixed method apaches data will be collecting concurrently or sequentially

When data are collected concurrently, the two forms (quantitative and qualitative) of data are independent of each other; when collected sequentially, the two forms of data are related or connected.

Regardless of the concurrent or sequential data collection, always use precise quantitative and qualitative procedures.

Cont….

There are two types of issues that were faced during the mixed method data collection

concurrent data collection issues Participation selection The sample size question When contradictory results occur

Sequential data collection issues sampling the same or different individuals using the same or different sample sizesDesigning an instrument

Issues in Mixed Method Data Collection

Procedures Qualitative and Quantitative Data Analysis

Quantitative ProceduresGeneral

Procedures in Data Analysis

Qualitative Procedures

Coding data by assigning numeric values Cleaning the database Recoding or computing new variables for

computer analysis Establishing codebook

Preparing the data for analysis

Organizing documents and visual data Transcribing text Preparing the data for computer analysis

Visually inspecting data Conducting a descriptive analysis Checking for trends and distributions

Exploring the data Reading through the data Writing memos Developing qualitative codebook

Choosing an appropriate statistical test Analyzing to answer research questions or

test hypotheses Reporting inferential tests, effect sizes,

confidence intervals using quantitative statistical software

programs

Analyzing the data Coding the data Assigning labels to codes Grouping codes into themes (or categories) Interrelating themes (or categories) or

abstracting to smaller set of themes Using qualitative software programs

Representing results in statements of results Providing results in tables and figures Representing the data

analysis Representing findings in discussions of themes

or categories Presenting visual models, figures, tables

Using external standards Validating and checking the reliability of

scores from past instrument use Establishing validity and reliability of current

data

Validating the data Using researcher, participant, and reviewer standards

Employing validation strategies (e.g., member checking, triangulation, peer review)

Analyzing Data in Mixed Methods Research

Concurrent Data Analysis

Stage 1. Separate QUAL and QUAN analysis

Stage 2. Merge the two datasets

QUAL data analysis:

· Prepare the data· Explore the data· Analyze the data · Represent the results

QUAN data analysis:

· Prepare the data· Explore the data· Analyze the data · Represent the results

· Merge the two datasets· Transform the data and relate or compare

the data· Compare the results (discussion or

matrices)

Sequential Data Analysis

Stage 1. Separate QUAN data analysis

Stage 2. Identify QUAN results to use

Stage 3. Apply select QUAN results to qual phase

QUAN data analysis

Options· Outliers· Extreme cases· Significant-no

significant results· Demographics· Comparisons groups

· Select cases· Explain results· Compare groups

a. Sequential Embedded and Explanatory Designs

Cont….

b. Sequential Embedded and Exploratory Designs

Stage 1. Separate QUAL data analysis

Stage 2. Identify QUAL results to use

Stage 3. Apply select QUAL results to quan phase

QUAL data analysis

Options

· Codes and themes· Significant statements · Models

· To recruit cases· T o shape intervention· To test QUAL model· To develop an instrument

General Guidelines

choice of a design needs to be partly based Point of view of researcher review of past research for giving strength to the

research project It also aids the reader when the writer takes care to

tell a coherent and cohesive story throughout the qualitative and quantitative aspects of the research study.

Writing and Evaluating Mixed Methods Research

INTRODUCTION TO

BRM MODULE

Apr 11, 2023 31Azra Naheed Center for Research and Development

Superior University Lahore

Course Objectives To introduce the basic philosophical and methodological

approaches currently used as a foundation for research in Business, Management and Social Sciences.

To discuss critically the conventional distinction between “quantitative and qualitative” research and its usefulness in planning and evaluating research.

To develop the skills of literature review and critical analysis of research reports by giving practical exposure to locating literature and reviewing critically by argumentation, reading analysis and mapping.

To provide a comprehensive knowledge about the research design including introduction, purpose statement, research questions, hypothesis, use of theory limitations and significance for the development of rationale in research.

To provide a comprehensive understanding about quantitative research and develop their skills in different areas like operationalization, quantitative methods and ensure the reliability and validity of the data.



Cont…. To make a clear understanding for the use of SPSS (which

is related to their previous course “Quantitative Techniques”).

To provide a comprehensive understanding about qualitative research and develop their skills in using valid and reliable qualitative methods.

To discuss various ways of designing research which focuses on the purpose of research, the use of theory and the research significance, its limitations and delimitations.

To present a range of ethical issues relevant to the conduct and publication of research.

To give an introduction of Nvivo (for qualitative data analysis).



Classification Topics

Knowledge and Comprehension

At the end of this module, successful students will be able to demonstrate the knowledge of: A range of methodological approaches and philosophical assumptions to organizational

and professional research. Ways of formulating and defining business and management research problems,

significance or limitations. Understanding of Literature Review and critical Analysis Issues in, and methods of, research design. The importance of ethics and values in business research. The requirements for effective analysis and interpretation of quantitative, qualitative

data and mixed methods.

Application and Skills

At the end of this module, the successful students will be able to: Make informed decisions about different research approaches, strategies, design and

methods which are relevant to different purposes To write a literature review related to business research problems. To conduct interviews and interpret them to develop results. To conduct surveys and develop analysis & interpretation of them. Write a successful research proposal which outlines and evaluates the research process

and method(s) most appropriate to investigate the student’s own research questions/subject.

Analysis and Synthesis

At the end of this module successful students will be able to: Critically evaluate the range of qualitative and quantitative data and information

collection strategies in a meaningful manner to solve problems. To analyze the research and findings of other people. Analyze the quantitative & Qualitative data for interpretation of results.



Final AssignmentTO DEVELOP A RESEARCH PROPOSAL FOR AN APPROVED RESEARCH PROBLEM Guidelines and Assessment Criteria: Write a research proposal for a specific project of research, addressing in an

analytical way, the following issues:(a) Abstract(b) Aims of the investigation:

Including the need for / value of the research(c) Problem formulation:

Relevant social / business context Main research questions / hypothesesBrief summary of theoretical / conceptual bases of the project Target population of interest

(d) Selective literature review: Brief summary (max. 3000 words) of the areas to be addressed, and of illustrative resources, including selective bibliography in recognized format

(e) Initial choice of methodological approach * and research strategy (ies)(f) Fieldwork:

An outline (only) of plans for methods of data production / sources, and for negotiating access

(g) Research design:

Outline of plans for indicators / descriptors for key concepts Methods for ruling out alternative explanations (or descriptions) Sampling procedures / selection of cases (organizations or individuals)

(h) Discussion of issues of validity and reliability – or alternative criteria for research quality (to be clearly specified)(i) Ethical and other commitments:

Brief discussion of any major ethical or legal dilemma and political or organizational constraints etc.



Presentation The aim of the presentation is to allow students to gain constructive feedback from their peers regarding

their comparative reports as well as allowing them to demonstrate their presentation skills. The structure of the presentation will largely mirror the structure of the report and thus contain the comparison on the basis of three basic research approaches i.e. qualitative, quantitative and mixed methods.

Points to consider when marking presentations are:◦ Timing of presentation.◦ Clarity of concepts.◦ Structure of the presentation.◦ Quality of overheads, handouts etc. ◦ Application of theory to practice.◦ Ability to answer questions effectively.◦ Use of sources of information.

Criteria of Assessment Clarity and conciseness of your specification of various aspects of the proposal. The relation of details of your research design specifically to the aims of your particular study (That is,

credit will not be given for the production of generalities about research design that are unrelated to any particular study).

Justification of key decisions made. Completeness of coverage of guidelines.



Weighting: 20 Marks◦ Guidelines (a,b,c) (5% + 5% + 15%) 25%◦ Guidelines (d,e) 15% ◦ Guidelines (f,g) 40% ◦ Guideline (h) 10%◦ Presentation (including bibliography in a recognized format) 10%

Length: Maximum 6000 words, plus references (at most 10) in selective bibliography (based on selective

literature review).

Weightage: 30% (project: 20%, presentation: 10%)

Due dates: 13th WeekShort Working Draft: 11th Week (This draft only: max. 2000 words, submitted electronically to module tutor by the time announced; any

draft submitted after that would not be given any feedback).

Final Draft: To be announced later.9. Reference Material



PROPOSAL

WRITINGApr 11, 2023

38Azra Naheed Center for Research and Development Superior University Lahore

ProposalProposal is the written document that describes the topic, Problem, design, and methodologies to be adopted to conduct the proposed research.

Why Proposal

The development of proposal for any research study is essential because • It allows the researcher to plan and review the

steps of the project.• It serves as a guide throughout the investigation.• It forces time and budget estimates

Apr 11, 202339Azra Naheed Center for Research and Development


Outline of the structure of a proposal

1. Title

2. Introduction• Background of the study (Sectoral Brief)• The research problem• Studies that have addressed the problem• Deficiencies in the studies• The significance of the study• The purpose statement

3. Purpose• The purpose or study, aim of the project and reasons for the

research design• The research questions and hypotheses

4. Philosophical Foundations worldview and philosophical assumptions for using specific

research approach.

5. Literature Review



Outline of the structure of a proposal

6. Methodology and Methods

• Site and sample • Data collection procedures • Data analysis procedures

7. Potential Ethical issues8. Reference and appendixes



Education

Mixed Method Data