28
THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Embed Size (px)

Citation preview

Page 1: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

THE MEASUREMENT OF USER INFORMATION SATISFACTION(BLAKE IVES ET.AL)Presented by:

IRA GERALDINA - 0806435513

Page 2: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Outline

Introduction The User Information Satisfaction

Construct Measuring User Information Satisfaction A Study to Assess a UIS Measure Improving Instrument Quality Producing a Short Form Conclusion

Page 3: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Introduction

Page 4: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

The User Information Satisfaction Construct

Page 5: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

The User Information Satisfaction Construct

Page 6: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Measuring User Information satisfaction

Page 7: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Example

Page 8: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

A Study to Assess A UIS Measure Study objectives:

(1) replicate Pearson’s findings concerning the validity of the instrument(2) reinforce the validity of the instrument through further tests(3) reduce the length of the overall measure while maintaining reasonable level of reliability and the existing structure of scales(4) develop a standard “short form” instrument

Page 9: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

A Study to Assess A UIS Measure Methodology:

- Survey to 800 production managers in U.S. manufacturing organizations- 2 month period for two separate mailings: (1)

Pearson’s UIS measure; (2) 4 item measure of

information satisfaction/ UIS4- Final sample: 280 managers (35% response rate)

Page 10: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

A Study to Assess A UIS Measure Results: See Table III & IV

- Reliability- Content validity- Predictive validity- Construct validity

Page 11: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Reliability

Page 12: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Content of Validity

It refers to the representativeness or sampling adequacy

All scales are positive and significant at the 0.001 level

Page 13: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Predictive Validity

Demonstrated by correlating a measure against other measures of the same construct

A correlation of 0.55 was obtained and significant at the 0.001 level

Page 14: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Construct Validity

Demonstrated by validating the theory behind the instrument

2 Methods:- Total score >> See column 4 (UIS38) of Table IV, all significant at 0.001 level- Factor analysis >> See Table III, resulting 5

factors

Page 15: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Factor Analysis

Page 16: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Improving Instrument Quality

Page 17: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Elimination of Scales

Each scale was ranked on the following criteria:(1) reliability(2) content validity(3) construct validity

See Table IV- Triple asterisk were selected for elimination

Page 18: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Reducing the Number of Items per Scale Holdback sample data was tested Removing items within a scale that had

the lowest correlation with the other items

See Table V, two items were then eliminated

Page 19: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Producing A Short Form

Entails selecting representatives scales that has an acceptable high correlation with the full instrument

The correlation was 0.90 (significant at 0.001 level)

Contact the authors to have short form questionnaires

Page 20: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Conclusion

The instrument presented here is a potential candidate for adoption

Page 21: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

A SHORT FORM MEASURE OF UIS: A PSYCHOMETRIC EVALUATION AND NOTES ON USE

BARAUDI & ORLIKOWSKI

Page 22: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

The Purpose of Study

To conduct a psychometric evaluation of the short-form of UIS measure are developed by Ives, Olson, and Baroudi

To discuss how the short-form of UIS can be used to (a) detect the presence of user dissatisfaction(b) aid the diagnosis of problem areas

Page 23: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Sample

358 employees from 26 New York area organizations

See Table 1

Page 24: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Sample’s Distribution

Page 25: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

The UIS Questionnaire

Page 26: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Validity

Page 27: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513
Page 28: THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA - 0806435513

Reliability