Researching Online and Online Learning

Research

Sanjaya Mishra, PhD

Objectives of the Sessions

• Explain the meaning of online research;• Identify different types of ways to do online research;• Discuss issues related to online research;• Design online research;• Conduct research and/or construct online research

instruments; and• Use online research resources.

At the end of the combined two session, you are expected to be able to:

Researching Online

• Doing research using online technologies, essentially to collect data

• Needs understanding of the technologies used

• Research methods and design remain the same, it is only the use of technology that makes the process of research different

• But, without a strong background on research methodology, use of technology alone would not be useful

Online Learning Research

• Research on online learning as a theme/topic

• This could be done both online and offline

• Mostly use online research, but not necessarily so

What you have learned so far?• Identified research areas/topics• Developed research designs• Clarified about methodologies• Developed instruments• Used statistical packagesYOU can do all these using online

technologies.

Why Online Research?

• Saves time• Saves money• Ease of data processing• Dynamic error checking• Option of putting questions in random• Multimedia capabilities of the web• Sensitive topics can be handled in confidence• Can handle large number of individual subjects• Increase respondent’s motivation to participate

Types of Online Research

Non-Probability Approaches• Entertainment survey (e.g. single question surveys on

websites, polls, etc.)• Self-selected web surveys (use of open invitation on

portals, websites, mailing list based, etc.)• Volunteer panel of Internet users (e.g. Zoomerang)Probability Approaches• Intercept surveys (e.g. pop-up window polls given to

every 7th visitor of a site)• List-based samples of respondents (e.g., email collected

with consent to participate)• Pre-recruited panel with web access (e.g. expert

groups)• Mixed-mode designs with choice of completion method• Probability sample of full population (pre-recruited

panel given technology access)Source: Couper, M.P (2000) Web surveys: A review of issues and

approaches, Public Opinion Quarterly, 64, pp.464-494.

Types of Online Research Technologies

• Email• Email attachment• Web Forms (widely used)• One-to-one Text interview (chat)• One-to-one A/V interview (chat)• Focus group discussion via chat• Focus group though collaboration

software

Issues in Online Research

• Sampling issues• Response rates• Ethical issues • Design issues• Technical issues

Sampling Issues

Sample selection bias due to:• Access to Internet• Comfort with Internet survey format

(preference for print over online response)• Effect of self-selection (as opposed to random

selection)• Validity of respondents (their eligibility to

respond to a survey)• Multiple responses from the same respondent

Response Rate

• What is a response rate in online research?• Poor response rate like mail survey• Improves considerably due to constant online

reminders• Fast response (average response time within

10 days)• Low effect of social desirability• Non-response or incomplete response problem

(progress indicator suggested)

Types of Respondents

1. Unit non-responders2. Complete responders3. Answering drop-outs4. Lurkers5. Lurking drop-outs6. Item non-responders7. Item non-responding

drop-outs

Source: Bosnjak, M.M. and Tuten, T.L. (2001) Classifying response behaviours in web-based surveys, Journal of Computer Mediated Communication, 6 (3), Available at http://jcmc.indiana.edu/vol6/issue3/boznjak.html

Ethical Issues

• Informed prior consent• Privacy: confidentiality and security• Incentives to respondents• Use of online student data, and their

work• Time spent to make observations in

chat rooms and discussion forums

Design Issues

1. Use welcome screen to introduce and motivate the respondents

2. Design the forms appropriately3. Avoid using drop down menus4. Use conventional format as a printed form5. Break long surveys into parts to avoid scrolling6. Use open ended questions sparingly7. Use incentives to get people to respond8. Use progress bar9. Avoid force questions10. Give an estimated time to complete the survey11. Allow an alternate mode of response

Technical Issues

• Knowledge of HTML and form design• Knowledge of server side administration

for data capturing• Knowledge of databases• Knowledge of statistical software• All the above or just knowledge of

Internet access to use online survey software

A Framework for Online Research

SurveyOr

Interview

Sampling

Technology

Administration

Design

Analyses

Online Learning Research Trends

• Student experience and satisfaction of online learning environments

• Comparative experimental studies on online learning, traditional distance learning and classroom learning

• Content analysis of computer mediated communication

• Interactions in discussion forum and online communities

Research Framework for Online Learning

SOCIAL PRESENCE

TEACHING PRESENCE

COGNITIVEPRESENCE

Supporting discourse

Setting climate

Online Experience

Teaching-learning Process

Adapted from: Garrison, D.R. and Anderson, T. (2003) E-Learning in the 21st Century: A Framework for Research and Practice, RoutledgeFalmer: London

Online Research Resources

Sample only• Use online databases (ProQuest, EBSCO, IELOnline, J-

Gate, ACM Digital Library)• Search COLFinder, GoogleScholar• Starting points for Internet research

(http://owl.english.purdue.edu/internet/tools/research.html)

• Web survey software (Surveymonkey, QuestionPro, HostedSurvey, WebSurveyor)

THANK YOUYour comments and questions are

welcome, before we break for practical work.

After practical work, please re-assemble in the plenary and show your work to the group.

ACTIVITY (45 min)

Design a 10 item questionnaire on a topic of your choice using an online survey software and distribute it to a group of sample respondents.

ORConduct interview of two persons on issues

related to accreditation of degrees in distance education using a messaging tool.