Embed Size (px)
Citation preview
Modeling Preferences of a Group Member
Farrokh Alemi, Ph.D.
Alemi at Georgetown 2
Steps in Participatory Vendor Selection
1. Invite stakeholders to participate
2. One-on-one interviews
3. Group meeting
4. Constructing scoring procedures
5. Group Discussion
6. Measuring Vendor performance
7. Documentation
Alemi at Georgetown 3
Steps in Participatory Vendor Selection
1. Invite stakeholders to participate
2. One-on-one interviews
3. Group meeting
4. Constructing scoring procedures
5. Group Discussion
6. Measuring Vendor performance
7. Documentation
Focus of this set of slides
Objectives
Prepare for the meeting
Construct straw modelsSolicit attributesDescribe attribute levels Identify scoring procedure
Alemi at Georgetown 4
Alemi at Georgetown 5
Additive Multi-Attribute Value Model
Overall Value = function {V(A1)+V(A2) +…+V(An)}
Value on Attribute 1
Value on Attribute 2
Value on Attribute n
Alemi at Georgetown 6
Misleading Numbers
Numbers approximate preferences
Build behavioral consensus
Steps in Modeling Preferences
1. Introductions
2. Solicit attributes
3. Identify attribute levels
4. Rate attribute levels
5. Assess importance of attributes
6. Evaluate accuracy
7. Discuss next steps
Alemi at Georgetown 7
Step 1: Introductions
Introduction of the analyst The taskProcess of vendor selection
Introduction of decision maker
Alemi at Georgetown 8
Alemi at Georgetown 9
Step 2: Select Attributes
a) Start with tangible examples of EHR that worked well and those that worked poorly
b) Ask directly for additional attributesc) Arrange the attributes in a hierarchy
• Always use the expert's terminology • Use prompts that feel most natural• Take notes and do not interrupt
Alemi at Georgetown 10
Step 2: Select Attributes
a) Start with tangible examplesb) Ask directly for additional attributesc) Arrange the attributes in a hierarchy
• Always use the expert's terminology • Use prompts that feel most natural• Take notes and do not interrupt
Alemi at Georgetown 11
Step 2: Select Attributes
a) Start with tangible examplesb) Ask directly for additional attributesc) Arrange the attributes in a hierarchy
• Always use the expert's terminology • Use prompts that feel most natural• Take notes and do not interrupt
Alemi at Georgetown 12
Step 2: Select Attributes
a) Start with tangible examplesb) Ask directly for additional attributesc) Arrange the attributes in a hierarchy
Always use the decision maker’s terminology • Use prompts that feel most natural• Take notes and do not interrupt
Alemi at Georgetown 13
Step 2: Select Attributes
a) Start with tangible examplesb) Ask directly for additional attributesc) Arrange the attributes in a hierarchy
• Always use the expert's terminology Use prompts that feel most natural
• Take notes and do not interrupt
Alemi at Georgetown 14
Step 2: Select Attributes
a) Start with tangible examplesb) Ask directly for additional attributesc) Arrange the attributes in a hierarchy
• Always use the expert's terminology • Use prompts that feel most natural
Take notes and do not interrupt
Alemi at Georgetown 15
Step 2: Select Attributes
Example attributes Easy to use Improve one or more business processes Most value for cost Fit with long term business strategy Vendor responsive to practice information needs Strong testimonies from prior users In use by other practice sites Compatible with existing systems
Step 3: Identify Attribute Levels
1. Selecting the best and worst levels
2. Define intermediate levels
3. Fill in the other possible levels
Alemi at Georgetown 16
Step 3: Identify Attribute Levels
1. Selecting the best and worst levels
2. Define intermediate levels
3. Fill in the other possible levels
Alemi at Georgetown 17
Step 3: Identify Attribute Levels
1. Selecting the best and worst levels
2. Define intermediate levels
3. Fill in the other possible levels
Alemi at Georgetown 18
Step 4: Rate Attribute Levels
No cost (open software)
$5000/physician
$10,000/physician
$20,000/physician
$30,000/physician
$40,000/physician
Alemi at Georgetown 19
Step 4: Rate Attribute Levels
No cost (open software)
$5000/physician
$10,000/physician
$20,000/physician
$30,000/physician
$40,000/physician
Alemi at Georgetown 20
100
0
Step 5: Assign Importance of Attributes
Alemi at Georgetown 21
Step 5: Assign Importance of Attributes
Alemi at Georgetown 22
Arrange attributes from least important to most important
Assign the least important attribute the value of 10
How many more times the next attribute is more important?
Step 5: Assign Importance of Attributes
Alemi at Georgetown 23
Step 5: Assign Importance of Attributes
Alemi at Georgetown 24
Step 5: Assign Importance of Attributes
Alemi at Georgetown 25
Step 5: Assign Importance of Attributes
Alemi at Georgetown 26
Step 5: Assign Importance of Attributes
Alemi at Georgetown 27
Step 5: Assign Importance of Attributes
Alemi at Georgetown 28
Step 6: Evaluate Hypothetical Vendors
Vendor A Vendor B Vendor C
Attribute Weight Level Rating Level Rating Level Rating
Ease of use 0..3 2 minutes 100 3 minutes 80 5 minutes 0
Cost per MD 0.4 11,000 70 15,000 0 9000 100
Reputation 0.2 Good 0 Excellent 100 Good 0
Alemi at Georgetown 29
Alemi at Georgetown 30
Step 7: Next Step
Walk through group meeting
Answer questions
Take Home Lesson
Listen to the Decision Maker
