16
MANAGEMENT SCIENCE Vol. 11, No. 10, August, 1066 Printed in U.S.A. STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOSf ano PAUL A. STliASSMANN| This paper describes an improved method for investment decision making. The method, which is called the stochastic decision tree method, is particularly applicable to investments characterized by high uncertainty and requiring a sequenco of related decisions to be made over a period of time. The stochastic decision tree method builds on concepts used in the risk analysis method and the decision tree method of analyzing investments. It permits the use of subjective probability estimates or empirical frequency distributions for some or all factors affecting the decision. This application makes it practicable to evaluate all or nearly all feasible combinations of decisions in the decision tree, taking account of both expected value of return and aversion to risk, thus arriving at an optimal or near optimal set of decisions. Sensitivity analysis of the model cm highlight factors that are critical because of high leverage on the measure of performance, or high uncertainty, or both. The method can be applied relatively easily to a wide variety of investment situations, and is ideally suited for computer simulation. Investment decisions are probably the most important and most difficult deci- sions that confront top management, for several reasons. First, they involve enormous amounts of money. Investments of U. S. companies in plant and equip- ment alone are approaching $50 billion a year. Another $50 billion or so goes into acquisition, development of new products, and other investment expenditures. Second, investment decisions usually have long-lasting effects. They often represent a "bricks and mortar" permanence. Unlike mistakes in inventory de- cisions, mistakes in investment decisions cannot be worked off in a short period of time. A major investment decision often commits management to a plan of action extending over several years, and the dollar penalty for reversing the deci- sion can be high. Third, investments are implements of strategy. They are the tools by which top management controls the direction of a corporation. Finally, and perhaps most important, investment decisions are characterized by a high degree of uncertainty. They are always based on predictions about the future—often the distant future. And they often require judgmental estimates about future events, such as the consumer acceptance of a new product. For all of these reasons, investment decisions absorb large portions of the time and atten- tion of top management. Investment decision-making has probably benefited more from the develop- ment of analytical decision-making methods than any other management area. In the past 10 or 15 years, increasingly sophisticated methods have become avail- able for analyzing investment decisions. Perhaps the most widely known of these new developments arc the analytical methods that take into account the time * Received February 1905. t MoKinsey and Company, Inc., New York J National Dairy Products Corporation, New York B-244

STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

MANAGEMENT SCIENCE Vol. 11, No. 10, August, 1066

Printed in U.S.A.

STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS*

RICHARD F. 1 IESPOSf ano PAUL A. STliASSMANN|

T h i s paper descr ibes an improved method for i n v e s t m e n t decis ion making. T h e m e t h o d , which is cal led the s tochast i c decis ion tree method, is part icular ly appl icab le to i n v e s t m e n t s characterized by high uncertainty and requiring a s equenco of re lated dec is ions to be made over a period of t ime . T h e s t o c h a s t i c dec i s ion tree m e t h o d builds on concepts used in the risk ana lys i s m eth od and the dec is ion tree m e t h o d of ana lyz ing inves tments . It permi t s the use of s u b j e c t i v e probabi l i ty e s t imate s or empirical frequency d is tr ibut ions for some or all f ac tors a f fec t ing the decis ion. This appl icat ion makes it pract icable to e v a l u a t e all or nearly all feasible combinat ions of decis ions in the dec is ion tree, tak ing a c c o u n t of both expected value of return and avers ion to risk, thus arr iv ing at an opt imal or near opt imal s e t of decis ions. Sens i t i v i ty ana lys i s of the model c m h igh l igh t factors that are critical because of high leverage on the measure of performance , or high uncerta inty , or both. T h e method can be appl ied re la t ive ly eas i ly to a wide variety of inves tment s i tuat ions , and is idea l ly s u i t e d for computer s imulat ion .

Investment decisions are probably the most important and most difficult deci-sions that confront top management, for several reasons. First, they involve enormous amounts of money. Investments of U. S. companies in plant and equip-ment alone are approaching $50 billion a year. Another $50 billion or so goes into acquisition, development of new products, and other investment expenditures.

Second, investment decisions usually have long-lasting effects. They often represent a "bricks and mortar" permanence. Unlike mistakes in inventory de-cisions, mistakes in investment decisions cannot be worked off in a short period of time. A major investment decision often commits management to a plan of action extending over several years, and the dollar penalty for reversing the deci-sion can be high. Third, investments are implements of strategy. They are the tools by which top management controls the direction of a corporation.

Finally, and perhaps most important, investment decisions are characterized by a high degree of uncertainty. They are always based on predictions about the future—often the distant future. And they often require judgmental estimates about future events, such as the consumer acceptance of a new product. For all of these reasons, investment decisions absorb large portions of the time and atten-tion of top management.

Investment decision-making has probably benefited more from the develop-ment of analytical decision-making methods than any other management area. In the past 10 or 15 years, increasingly sophisticated methods have become avail-able for analyzing investment decisions. Perhaps the most widely known of these new developments arc the analytical methods that take into account the time

* Rece ived February 1905. t M o K i n s e y and C o m p a n y , Inc. , New York J N a t i o n a l Dairy P r o d u c t s Corporation, N e w York

B-244

Page 2: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

T H E ANALYSIS OF I N V E S T M E N T D E C I S I O NS JB-245 value of money. These include the net present value method, the discounted cash flow method, and variations on these techniques. [4, 13] Complementary to these time-oriented methods, a number of sophisticated accounting techniques have been developed for considering the tax implications of various investment pro-posals and the effects of investments on cash and capital position. [2, 12, 16] Considerable thought has been given to the proper methods for determining the value of money to a firm, or the cost of capital. [12, 13] The concepts of replace-ment theory have been applied to investment decisions on machine tools, auto-mobile fleets, and other collections of items that must be replaced from time to time. [16]

In a somewhat different direction, techniques have been developed for the selection of securities for portfolios. These techniques endeavor to select the best set of investments from a number of alternatives, each having a known expected return and a known variability. [11] In this context, the "best" selection of invest-ments is that selection that either minimizes risk or variability for a desired level of return, or maximizes return for a specified acceptable level of risk. (In general, of course, it is not possible to minimize risk and maximize return simultaneously.) The application of these techniques to corporate capital budgeting problems is conceivable but not imminent.

In the evolution of these techniques, each advance has served to overcome certain drawbacks or weaknesses inherent in previous techniques. However, until recently, two troublesome aspects of investment decision making were not ade-quately treated, in a practical sense, by existing techniques. One of these prob-lems was handling the uncertainty that exists in virtually all investment deci-sions. The other was analyzing separate but related investment decisions that must be made at different points in time.

Two recent and promising innovations in the methodology for analyzing invest-ment decisions now being widely discussed are directed at these two problems. The first of these techniques is commonly known as risk analysis; [6, 8] the second involves a concept known as decision trees. I'J, 10, 15] Each of these techniques has strong merits and advantages. Both are beginning to be used by several major corporations.

It is the purpose of this article to suggest and describe a new technique that combines the advantages of both the risk analysis approach and Die decision tree approach. The new technique has all of the power of both antecedent techniques, but is actually simpler to use. The technique is called the stochastic decision tree approach.

To understand the stochastic decision tree approach, it is necessary to under-stand the two techniques from which it was developed. A review of these two techniques follows.

A Review of Risk Analysis Risk analysis consists of estimating the probability distribution of each factor

affecting an investment decision, and then simulating the possible combinations of the values for each factor to determine the range of possible outcomes and the

Page 3: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

B-246 RICHARD F IIESP0S AND PAUL A STKASSMANN

FIGURE 1

TWO A N A L Y S E S OF AN I N V E S T M E N T PROPOSAL

F A C T O R " B E S T G U E S S " ANALYS I S RISK ANALYS IS

PROBABILITY

Size of Investment

Net Annual Savings

L i fe of Investment

Net Pre ent Value

10 years

probability associated with each possible outcome If the evaluation of an invest-ment decision is based only on a single estimate—the "best guess"—of the value of each factor affecting the outcome, the ìesulting evaluation will be at best in-complete and possibly wiong This is tiue especially when the investment is large and neither cleaiiy attractive nor cleaily unattiactive Risk analysis is thus ap important advance over the conventional techniques The additional information it provides can be a gieat aid 111 investment decision making

To illustrate the benefit of the risk analysis technique, Figuie 1 shows the re-sults of two analyses of an investment proposal Fust, the piopo&al was analyzed by assigning a single, "best guess" value to each factoi The second analysis used an estimate of the probability disti ìbution associated with each factor and a sim-ulation to determine the probability disti ìbution of the possible outcomes

The best-guess analysis indicates a net piesent value of $1,130,000, whereas the nsk analysis shows that the most likely combination of events gives the pioj-ect an expected net piesent value of only $252,000 The conventional technique

Page 4: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

T H E ANALYSIS OF INVESTMENT DECISIONS JB-247 FIGURE 2

USE OF S E N S I T I V I T Y A N A L Y S I S TO H I G H L I G H T C R I T I C A L F A C T O R S

AN U N F A V O R A B L E C H A N G E OF 10 P E R C E N T I L E S

FROM T H E M E A N V A L U E IN THIS F A C T O R

Annuo l net c o s h flow

So le s level

Se l l i ng price

Manufactur ing co s t

F i x e d cast ^

Amount of investment 5

L i fe of investment 1 2

12 17

10 21 58

6

12

30

tails to take into account the skewed distnbutions of the various factois, the mteiactions between the factois, and is influenced by the subjective aspects of best guesses Fuitheimore, the conventional analysis gives no indication that this investment has a 48 peieent chance of losing money Knowledge of this fact could gieatly affect the decision made 011 this pioposal, particulaily if the in-vestor is conservative and has less risky alternatives available

The risk analysis technique can also be used for a sensitivity analysis The purpose of a sensitivity analysis is to deteimme the influence of each factor 011 the outcome, and thus to identify the factois most critical 111 the investment decision because of then high levei age, high unceitainty, 01 both In a sensitivity analysis, equally likely vanations 111 the values ot each factor aie made systematically to deteimme then effect 011 the outcome, 01 net piesent value Figure 2 shows the effect of individually vaiying each input factoi (seveial of which aie components of the net cash inflow)

This analysis indicates that manufactuiing cost is a highly entical factoi, both 111 levei age and uncertainty Knowing this, management may concentiate its effoits on 1 educing manufactuiing costs 01 at least 1 educing the unceitainty 111 these costs

Risk analysis is rapidly becoming an established technique 111 Amencan 111-dustiy Seveial laige coipoiations are now using vanous foims of the technique as a legulai pait of then investment analysis pioceduie [1, 3, 7, 17, 18] A back-log of expei lence is being built up 011 the use of the technique, and advances 111 the state of the ait aie continually being made by useis For example, methods have been devised foi lepiesenting complex mtenelationships among factois Improvements aie also being made 111 the methods of gathenng subjective piob-abihty estimates, and bettei methods aie being devised tor peifoiming sensitivity analysis

One aspect of investment decisions still eludes the capabilities of this technique This is the pioblem ot sequential decision making—that is, the analysis ot a numbei ot highly lntei 1 elated investment decisions oeeuiimg at Jiffeient points

Page 5: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

B-248 RICHARD F I I E S P 0 S AND PAUL A STKASSMANN

USE OF D E C I S I O N T R E E TO A N A L Y Z E I N V E S T M E N T A L T E R N A T I V E S

FOR A NEW PRODUCT INTRODUCT ION

NPV (Milhons of

A Review of Decision Trees The decision tiee approach, a technique very similar to dynamic progiammmg,

is a convenient method foi lepresenting and analyzing a series of investment decisions to be made ovei time (see Figuie 3) Each decision point is repiesented by a numbered square at a foik or node in the decision tree Each branch ex-tending from a fork repiesents one of the alternatives that can be chosen at this decision point At the fust decision point the two alternatives 111 the example shown in Eiguie 3 aie "introduce pioduct nationally" and "introduce product regionally " (It is assumed at this point that the decision has aheady been made to introduce the product in some way )

In addition to representing management decision points, decision trees rep-resent chance events The forks in the tree where chance events influence the outcome aie indicated by cucles The chance event forks or nodes rn the example repiesent the various levels of demand that may appear for the product

A node representing a chance event geneially has a piobabihty associated with each of the blanches emanating from that node This probability is the likelihood that the chance event will assume the value assigned to the particular branch The total of such probabilities leadmg from a node must equal 1 In our example, the probability of achieving a large demand in the regional introduction of the pioduct is 0 7, shown at the branch leading from node A Each combination of decisions and chance events has some outcome (in this case, net present value, or NPV) associated with it

Page 6: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

T H E ANALYSIS OF INVESTMENT DECISIONS JB-249 FIGURE 4

NET P R E S E N T V A L U E OF I N V E S T M E N T A L T E R N A T I V E S FOR A NEW PRODUCT I N T R O D U C T I O N

A L T E R N A T I V E C H A N C E E V E N T

P R O B A B I L I T Y OF

C H A N C E E V E N T

N E T P R E S E N T

V A L U E E X P E C T E D

N P V

Introduce product nat ionol ly Lo rge nat ional demand 5 $ 7 5 I La rge reg ional , limited

nat ional demand 2 1 0 > Î 2 75

L imi ted demand 3 - 4 0 ) Introduce product reg iona l l y

(and distribute nationally if regional demand is

La r ge nat ional demand

La r ge reg ional, l imited

nat ional demand

5

2

4 5

- 0 5 j, 2 44

large) L im i ted demand 3 1 0 )

Introduce product reg iona l l y (and do not distribute nationally)

La r ge nat ional demand

La r ge reg ional , l imited

nat ional demand

5

2

2 5

70 > 1 95

L im i ted demand 3 1 0 ) The optimal sequence of decisions in a decision tiee is found by stalling at the

ught-hand side and "rolling backward " At each node, an expected NPV must be calculated If the node is a chance event node, the expected NPV is calculated for all of the branches emanating fiom that node If the node is a decision point, the expected NPV is calculated for each bianch emanating fiom that node, and the highest is selected In eithei case, the expected NPV of that node is earned back to the next chance event or decision point by multiplying it by the prob-abilities associated with blanches that it tiavels ovei

Thus in Figuie 3 the expected NPV of all branches emanating fiom chance event node C is $3 05 million ($4 5 X 71 + $ - 0 5 X 29) Similarly, the ex-pected NPV at node D is $2 355 million Now "rolling back" to the next node— decision point 2—it can be seen that the alternative with the highest NPV is "distribute nationally," with an NPV of $3 05 million This means that, if the decision makei is evei confionted with the decision at node 2, he will choose to distubute nationally, and will expect an NPV of $3 05 million In all further analysis he can ignore the other decision bianch emanating from node 2 and all nodes and branches that it may lead to

To peiform further analysis, it is now necessary to cany this NPV backwaid in the tiee The branches emanating from chance event node A have an overall expected NPV of $2 435 million ($1 X 0 3 + $3 05 X 0 7) Similaily, the expected NPV at node B is 2 75 million These computations, summanzed in Figure 4, show that the alternative that maximizes expected NPV of the entne decision tiee is "introduce nationally" at decision point 1 (Note that m this particular case theie aie no subsequent decisions to be made )

One drawback of the decision tiee approach is that computations can quickly become unwieldy The number of end points on the decision tiee increases veiy lapidly as the number of decision points oi chance events increases To make this appioach practical, it is necessaiy to limit the number of branches emanating fiom chance event nodes to a veiy small number This means that the probability

Page 7: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

B-250 R I C H A R D F I I E S P 0 S A N D P A U L A S T K A S S M A N N

distribution of chance events at each node must be lepiesented by a veiy few point estimates y

As a result, the ausweis obtained fiom a decision tiee analysis are often in-adequate The single answei obtained (say, net piesent value) is usually close to

FIGURE 5

R A N G E O F P O S S I B L E O U T C O M E S

F O R E A C H O F T H R E E A L T E R N A T I V E S

PROBABILITY 5 r

M I N T R O D U C E N A T I O N A L L Y

EXPECTED NPV = »2 75

(b) I N T R O D U C E R E G I O N A L L Y T H E N A C T " O P T I M A L L Y " "

J 1 1 | 1

1

JJ

EXPE NP »2

1

CTED V -44

1 1

% 1 f ,

i i i « $-4 - 2 0 2 A — ; 1 \r

NPV (Millions ol Dollars)

"Meaning, in this case, to maximize expected NPV

PROBABILITY EXPECTED NPV =

( c ) I N T R O D U C E R E G I O N A L L Y O N L Y

Page 8: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

T H E ANALYSIS OF INVESTMENT DECISIONS JB-251 the expectation of the probability distnbution of all possible NPVs However, it may vary somewhat from the expected NPV, depending on how the point esti-mates were selected f iom the undeilying distributions and on the sensitivity of the N PV to this selection piocess Fui thennoie, the decision t iee appioach gives no information on the lange of possible outcomes f iom the investment or the probabilities associated with those outcomes This can be a serious diawback

In the example in Figuies 3 and 4, the decision tiee appioach indicated tha t mtiodueing the pioduct nationally at once would be the optimal strategy foi maximizing expected N P V Ilowevei, the NPV of $2 75 million is simply the mean of thiee possible values of NPV, which aie themselves lepiesentat ive of an entire lange of possible values, as shown in Figuie 5a Conipaiing the iange of NPVs possible under each possible set of decisions shows a vastly difteient view of the outcome (See Figuies 5b and 5c )

Although the hrst alternative has the highest expected NPV, a lational man-agei could easily piefer one of the othei two The choice would depend on the utility function or the aveision to lisk of the managei oi his organization A man-agei with a linear utility function would choose the fh&t alternative, as shown m Figure Ga Howevei, it is piobably t iue that moU manageis would not choose the first alternative because of the high chance of loss, and the highei utility value tha t they would assign to a loss, as shown in Figuie bb This conseivatism in management is, to a large extent, the result of the system of rewards and punish-ments tha t exists in many laige corpoiations today Whether it is good oi bad is a complex question, not discussed heie

In spite of these shoi tconnngs, the decision tiee appioach is a veiy useful ana-lytical tool I t is paiticularly useful for conceptualizing investment planning and foi controlling and monitoiing an investment that stretches out over t ime For these reasons, the decision tree appioach has been, and will continue to be an important tool for the analysis of investment decisions

FIGURE 6

E X A M P L E S OF U T I L I T Y FUNCT IONS

iol L I N E A R U T I L I T Y F U N C T I O N

VALUE OF s

(b) M O R E T Y P I C A L

N O N L I N E A R U T I L I T Y F U N C T I O N

V A L U E OF f

•Li » 0 Com CHANGE IN AS5ET5 ($)

-L< •ss 0 Go,,,-change in assets ($)

Page 9: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

B-252 RICHARD F I I E S P 0 S AND PAUL A STKASSMANN

Combining These Appioaches: Stochastic Decision Tiees The complementary advantages and disadvantages of risk analysis and deci-

sion tiees suggest that a new technique might be developed that would combine the good points of each and eliminate the disadvantages The concept of stochas-tic decision tiees, introduced in the remainder of this article, is intended to be such a combination ty i

The stochastic decision tree approach is similar to the conventional decision tree approach, except that it also has the following featuies.

% All quantities and factors, including chance events, can be represented by continuous, empuieal piobability distnbutions

The infoimation about the lesults from any or all possible combinations of decisions made at sequential points in time can be obtained in a probabilistic fonn

If The piobability distnbution of possible lesults fiom any paiticular com-bination of decisions can be analyzed using the concepts of utility and risk

A discussion of each of these features follows

Replacement of Chance Event Nodes by Pi obabihty Distributions

The mclusion of piobability distributions for the values associated with chance events is analogous to addmg an aibitianly laige number of branches at each chance event node In a conventional decision tiee, the addition of a large number of blanches can serve to lepresent any empirical piobability distnbution Thus m the pievious example, chance event node B can be made to approximate more closely the desiied continuous piobability distnbution by incieasing the number of blanches, as shown in Figure 7a and 7b However, this approach makes the tiee very complex, and computation very quickly becomes burdensome or im-practical Therefore, two 01 three branches are usually used as a coaise approx-imation of the actual continuous piobability distnbution

Since the stochastic decision tree is to be based on simulation, it is not necessary to add a great many blanches at the chance event nodes In fact, it is possible to reduce the number of branches at the chance event nodes to one (See Figure 7c ) Thus, in effect, the chance event node can be eliminated Instead, at the point wheie the chance event node occurred, a random selection is made on each itera-tion fiom the appiopnate probabilistic economic model such as the break-even ehait shown in Figuie 8 and the value selected is used to calculate the NPV for that particular iteration The single biancli emanating fiom this simplified node then extends onward to the next management decision point, or to the end of the tiee This results in a diastic stieainlimng of the decision tiee as illustrated m Figuie 9

Replacement oj All Specific Values by Probability Distributions

In a conventional decision tree, factois such as the size of the investment in a new plant facility aie often assigned specific values Usually these values are ex-pressed as single numbers, even though these numbeis aie often not known with cei tainty

Page 10: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|
Page 11: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

B-254 RICHARD F I I E S P 0 S AND PAUL A STKASSMANN

FIGURE 8

T Y P I C A L P R O B A B I L I S T I C ECONOMIC MODEL

USED TO S E L E C T V A L U E S OF FACTOR S AT CHANCE E V E N T NODES

If the values of these factors could be represented instead by probability dis-tributions, the degiee of uncertainty characterizing each value could be expressed The stochastic decision tree appioach makes it possible to do this Since the ap-proach is basically a simulation, any 01 all specific values in the investment anal-ysis can be lepresented by probability distributions On each iteration in the simulation, a value for each lactor is randomly selected from the appiopriate frequency di&tnbution and used in the computation Thus, m the example, NPV can be calculated fiom not only empincal distributions of demand, but also prob-abilistic estimates of investment, cost, price, and othei factors

Evaluating all Possible Combinations oj Decisions

Since this stochastic decision tree appioach greatly simplifies the structure of the decision tiee, it is often possible to evaluate by complete enumeration all of the possible paths through the tree Poi example, if there aie five sequential de-cisions in an analysis and each decision offeis two alternatives, theie aie at most 32 possible paths through the decision tree This number of paths is quite man-ageable computationally And since most decision points aie two-sided ("build" oi "don't build," foi example), oi at worst have a veiy small nuinbei of alterna-tives, it is often feasible and convenient to evaluate all possible paths through a decision tiee when the stochastic decision tree appioach is used

Why is it sometimes desnable to evaluate all possible paths through a decision tree? As the inquiiy into the lisk analysis appioach showed, decisions cannot always be made conectly solely on the basis of a single expected value for each tactoi The loll-back technique ot the conventional decision tiee necessarily deals

Page 12: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

THE ANALYSIS OF INVESTMENT DECISIONS JB-255 FIGURE 9

S I M P L I F I E D D E C I S I O N T R E E

D I S T R I B U T E N A T I O N A L L Y

DO NOT •D I STR IBUTE N A T I O N A L L Y A

only with expected values It evaluates decisions (moie exactly, sets of decisions) by comparing their expectations and selects the largest as the best, in all cases

Howevei, the stochastic decision tiee approach pioduces pi obabilistic lesults for each possible set of decisions These probability distributions, associated with each possible path thiough the decision tree, can be compared on the basis of their expectations alone, if this is consideied to be sufficient But alternative sets of decisions can also be evaluated by comparing the piobabihty distributions as-sociated with each set of decisions, in a mannei exactly analogous to usk analysis (The details of this technique aie discussed in the next section ) Thus, the sto-chastic decision tiee appioach makes it possible to evaluate a series of interielated decisions spiead ovei time by the same kinds of risk and uncertainty catena that one would use in a conventional ask analysis

In a laige decision tree pioblem, even with the simplifications affoided by the stochastic decision tiee approach, complete enumeiation of all possible paths through the tiee could become computationally unpractical, or the compaason of the piobabihty distabutions associated with all possible paths might be too laboaous and costly

In such a case, two simplifications aie possible Fust , a modified veision of the loll-back technique might be used This modified loll-back would take account of the piobabihstic natuie of the information being handled Blanches of the tiee would be eliminated on the basis of dominance rathei than simply expected value [71 For example, a blanch could be eliminated if it had both a lower ex-pected letuin and a lugliei vaaance than an alternative branch A number of possible sets of decisions could be eliminated this way without being completely evaluated, leaving an efficient set of decision sequences to evaluate 111 moie detail

Computation could also be 1 educed by making decision mles befoie the simula-tion, such that if, on any iteiation, the value of a chance event exceeds some cri-tenon, the lesulting decision would not be consideied at all This has been done

Page 13: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

B-256 RICHARD F I I E S P 0 S AND PAUL A STKASSMANN

FIGURE 10

THE GPSS C O N C E PT OF D E C I S I O N T R E E S

WITH R I SK S I M U L A T I O N

m the example shown in Figure 3 If a limited demand appears at node A, national mtroduction of the product will not be evaluated In the sunulation, if demand were below some specified value, the simulation would not proceed to the decision point 2 This technique only saves computation effort—it does not simphfy the structure of the tiee, and if the cntenon is chosen propeily, it will not affect the final outcome

Recording Results in the Foi m of Probability Distributions

I t has aheady been shown that probability distiibutions are moie useful than single numbeis as measures ol the value of a paiticular set of decisions The sim-ulation approach to the analysis permits one to get these probability distiibutions relatively easily I t is t iue that the method smacks of biute foice However, the biute force lequired is entuely on the pait of the computei and not at all on the part of the analyst

The technique is sunply this On each iteration or path through the decision tree, when the computer encounters a binary decision point node, it is instructed to "split itself in two" and perform the appropriate calculations along both bran-ches of the tree emanating fiom the decision node (The same logic apphes to a node with three oi more branches emanating fiom i t ) Thus, when the computer completes a single iteiation, an NPV will have been calculated for each possible path thiough the decision tree These NPVs are accumulated in sepai ate prob-ability distiibutions This simulation concept is lllustiated in Figuie 10

At the completion of a suitable number of iterations, there will be a probability distubution of the NPV associated with each set of decisions that it is possible to make in passing thiough the tree These diffeient sets of decisions can then be

Page 14: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

T H E ANALYSIS OF INVESTMENT DECISIONS JB-257

compared, one against the other, m the usual lisk analysis mattei, as if they were alternative investment decisions (which in fact they aie) That is, they can be compared by taking into account not only the expected return, but also the shape of each probability distnbution and the effects of utility and risk On the basis of this, one can select the single best set of decisions, 01 a small numbei of possibly

FIGURE 11

R E S U L T S OF

S T O C H A S T I C D E C I S I O N - T R E E A N A L Y S I S

P R O B A B I L I T Y

Page 15: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

B-258 RICHARD F. HESPOS AND PAUL A. STRASSMANN

acceptable sets. These sets of sequential decisions can then be evaluated and a decision whether or not to undertake the investment can be made by comparing it to alternative investments elsewhere in the corporation or against alternative uses for the money.

Ail Example

To illustrate the kinds of results that can be expected from a stochastic deci-sion tree analysis, the new product introduction problem described earlier has been solved using this method. The results are shown in Figure 11.

The differences in the expected values of the outcomes can now be seen in proper perspective, since the results show the relationship of the expected values to the entire distribution of possible outcomes. Moreover, the expected values of these distributions will not necessarily be identical with expectations resulting from the conventional decision tree approach, because:

1. The interdependencics among the variables were not accounted for by the conventional approach.

2. The small number of point estimates used to approximate an enLire distribu-tion under the conventional approach did not utilize all the available informa-tion.

With the three alternatives presented in this form, it is easier to understand why a rational manager might choose an alternative other than the one with the highest expected value. Presented with the full range of possible outcomes related to each alternative, he can select that alternative most consistent with his per-sonal utility and willingness to take risk.

Using the Stochastic Decision Tree Approach Stochastic decision trees described here combine the best features of both risk

analysis and conventional decision trees and are actually simpler to construct and use than either of these. The steps for collecting data and conceptualizing the problem are the same for the stochastic decision tree approach as they are for the risk analysis approach. These steps are:

1. Gather subjective probability estimates of the appropriate factors affecting the investment.

2. Define and describe any significant inlerdependenciea among factors. 3. Specify the probable timing of future sequential investment decisions to be

made. 4. Specify the model to be used to evaluate the investment. The stochastic decision tree approach is ideally suited to the computer language

known as General Purpose Systems Simulator (GPSS). [5, 14] Although this language is not now capable of handling very complex interdependencies without certain modifications, it permits the solution of a very wide range of investment problems.

The structuring and solving of several sample problems have indicated that the stochastic decision tree approach is both easy to use and useful. The example in Figures 4, 5 and 6 shows emphatically how the stochastic decision tree approach

Page 16: STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT … · STOCHASTIC DECISION TREES FOR THE ANALYSIS OF INVESTMENT DECISIONS* RICHARD F. 1 IESPOS f ano PAUL A. STliASSMANN|

THE ANALYSIS OF INVESTMENT DECISIONS JB-259 c a n d e t e c t a n d d i s p l a y t h e p r o b a b l e o u t c o m e s of a n i n v e s t m e n t s t r a t e g y t h a t

w o u l d b e d e e m e d o p t i m a l b y t h e c o n v e n t i o n a l d e c i s i o n t r e e a p p r o a c h , b u t t h a t

m a n y m a n a g e m e n t s w o u l d d e f i n i t e l y r e g a r d a s u n d e s i r a b l e . O t h e r w o r k i s b e i n g

d o n e o n b o t h s a m p l e p r o b l e m s a n d r e a l w o r l d p r o b l e m s , a n d o n t h e d e v e l o p m e n t

a n d s t a n d a r d i z a t i o n ( t o a l i m i t e d e x t e n t ) of t h e c o m p u t e r p r o g r a m s f o r p e r f o r m -

i n g t h i s a n a l y s i s .

Summary T h e s t o c h a s t i c d e c i s i o n t r e e a p p r o a c h t o a n a l y z i n g i n v e s t m e n t d e c i s i o n s ¡8 a n

e v o l u t i o n a r y i m p r o v e m e n t o v e r p r e v i o u s m e t h o d s of a n a l y z i n g i n v e s t m e n t s . I t

c o m b i n e s t h e a d v a n t a g e s of s e v e r a l e a r l i e r a p p r o a c h e s , e l i m i n a t e s s e v e r a l d i s -

a d v a n t a g e s , a n d i s e a s i e r t o a p p l y .

R e f e r e n c e s

1. ANDERSON, S. L. AND HAI OUT, H. G . , "A T w o - b y - T w o D e c i s i o n Prob lem," Chemical Engineering Progress, Vol. 57, N o . 5, M a y 1961.

2. ANTHONY, RODERT N . (Edi tor ) , Papers on Return on Investment, Harvard b u s i n e s s School , B o s t o n , 1959.

3. " C h a n c e Fac tors M e a n i ng and U s e , " At lant i c Ref in ing C o m p a n y , Produc ing Depart -m e n t , J u l y 1962.

4. DEAN, JOEL, Capital Budgeting, N e w York , Co lumbia Univers i ty Press , 1951. 5. GOUUON, G . , " A General Purpose S y s t e m s S i m u l a t o r , " IBM Systems Journal, Vol. I . ,

Sep tember 1962. 6. HERTZ, DAVI D B. , "Risk Analys i s in Capi ta l I n v e s t m e n t , " Harvard Business Review,

J a n u a r y - F e b r u a r y , 1961. 7. HESS, SIDNEY W. AND Q UIGLEY, HARRY A. , "Analys i s of Risk in I n v e s t m e n t s Us ing

M o n t e Carlo T e c h n i q u e , " Chemical Eng ineer ing Progress S y m p o s i u m Series No . 42, Vol. 59.

8. HI LLI ER, FREDERI CK, S. , S tanford U n i v e r s i t y , " T h e D e r i v a t i o n of Probabi l i s t ic In-format ion for the E v a l u a t i o n of R i s k y I n v e s t m e n t s , " Management Science, April , 1963.

9. MAQEE, J OHN F. , " D e c i s i o n Trees for Dec i s ion M a k i n g , " Harvurd Business Review, J u l y - A u g u s t , 1964.

19. MACEE, JOHN F. , " H o w to Use Dec i s ion Trees in Capi ta l I n v e s t m e n t , " Harvard Busi-ness Review, S e t p e m b e r - O c t o b e r , 1961.

11. MARKOWI TZ, HARRY, Portfolio Selection, Efficient Diversification of Investments, N e w York, John Wiley and Sons , 1959.

12. MASSE, PI ERRE, Optimal Investment Decisions, Prent i ce Hal l , 1962. 13. MCLEAN, JOHN G . , " HOW to E v a l u a t e N e w Capi ta l i n v e s t m e n t s , " Harvard Business

Review, N o v e m b e r - D e c e m b e r , 1958. 14. Re ference Manual General Purpose S y s t e m s S i m u l a t o r I I , I B M , 1963. 15. SCHLAIEER, ROBERT, Probability and Statistics for Business Decisions, McGraw-Hi l l ,

1959. 16. TERDOROH, GEOROB, Business Investment Policy, M a c h i n e ry and All ied Products

I n s t i t u t e , Wash ington , D .O. , 1958. 17. TI I ORNB, H. C. AND WI SE, D. C. , American Oil C o m p a n y , " C o m p u t e r s in E c o n o m i c

E v a l u a t i o n , " Chemical Engineering, April 29, 1963. 18. "Venture A n a l y s i s , " Chemica l Engineer ing Progress Techn ica l M a n u a l , American

I n s t i t u t e of Chemica l Eng ineers .