CHAPTER 11 Decision Theory Chapter Outline INTRODUCTION 372 List of Alternatives 372 States of Nature 372 Payoffs 373 Degree of Certainty 373 Decision Criterion 374 THE PAYOFF TABLE 374 DECISION MAKING UNDER CERTAINTY 375 DECISION MAKING UNDER COMPLETE UNCERTAINTY 376 Maximin 376 Maximax 377 Minimax Regret 378 Principle of insufficient Reason 380 DECISION MAKING UNDER RISK 382 Expected Monetary Value 382 Expected Opportunity Loss 383 Expected Value of Perltet Information 384 Comment 385 DECISION TREES 385 DECISION MAKING WITH ADDITIONAL INFORMATION 388 An Example 389 Efficiency of Sample Information 392 Computing the Probabilities 393 SENSITIVITY ANALYSIS 395 370 UTILITY 400 SUMMARY 401 GLOSSARY 402 SOLVED PROBLEMS 403 PROBLEMS 412 Learning Objectives....................... ........ After completing this chapter, you should be able to: 1. Outline the characteristics of a decision theory approach to decision making. 2. Describe and give examples of decisions under certainty, risk, and complete uncertainty. 3. Construct a payoff table. 4. Make decisions using maximin, maximax, minimax regret, insufficient reason, and expected value criteria. 5. Determine the expected value of perfect information. 6. Use decision trees to lay out decision alternatives and possible consequences of decisions. 7. Determine whether acquiring additional information in a decision problem will be worth the cost. 8. Analyze the sensitivity of alternatives to probability estimates. 372 Part Two Stochastic Models UECISION theory represents a generalized approach to decision making, which often serves as the basis for a wide range of managerial decision making. The decision model includes a list of courses of action that are available and the possible consequences of each course of action. An important factor hi making a decision is the degree of certainty associated with the consequences. This can range anywhere from complete certainty to complete uncertainty, and it generally affects the way a decision is reached. The chapter presents two commonly used decision theory approaches, a payoff table and a decision tree. They provide structure for organizing the relevant information in a format conducive to making rational decisions. The chapter begins with a description of the characteristics of a decision model. INTRODUCTION "" ] Decision theory problems are characterized by the following: 1. A list of alternatives. 2. A list of possible future states of nature. 3. Payoffs associated with each alternative/state of nature combination. 4. An assessment of the degree of certainty of possible future events. 5. A decision criterion. Let's examine each of these. List of Alternatives The list of alternatives must be a set of mutually exclusive and collectively exhaustive decisions that are available to the decision maker. (Sometimes, but not always, one of these alternatives will be to "do nothing.") For example, suppose that a real estate developer must decide on a plan for developing a certain piece of property. After careful consideration, the developer has ruled out "do nothing" and is left with the following list of acceptable alternatives: 1. Residential proposal. 2. Commercial proposal # 1. 3. Commercial proposal #2. States of Nature States of nature refer to a set of possible future conditions, or events, beyond the control of the decision maker, that will be the primary determinants of the eventual consequence of the decision. The states of nature, like the list Chapter 11 Decision Theofy 373 of alternatives, must be mutually exclusive and collectively exhaustive. Suppose, in the case of the real estate developer, the main factor that will influence the profitability of the development is whether or not a shopping center is built, and the size of the shopping center, if one is built. Suppose that the developer views the possibilities as: 1. No shopping center. 2. Medium-size shopping center. 3. Large shopping center. In order for a decision maker to be able to rationally approach a decision problem, it is necessary to have some idea of the payoffs that would be associated with each decision alternative and the various states of nature. The payoffs might be profits, revenues, costs, or other measure of value. Usually the measures are financial. They may be weekly, monthly or annual amounts, or they might represent present values1 of future cash flows. Usually, payoffs are estimated values. The more accurate these estimates, the more useful they will be for decision making purposes and the more likely it is that the decision maker will choose an appropriate alternative. The number of payoffs depends on the number of alternative/state of nature combinations. In the case of the real estate developer, there are three alternatives and three states of nature, so there are 3X3 = 9 possible payoffs that must be determined. rt&iiity The approach used by a decision maker often depends on the degree of certainty that exists. There can be different degrees of certainty. One extreme is complete certainty and the other is complete uncertainty. The latter, exists when the likelihood of the various states of nature are unknown. Between these two extremes is risk, a term that implies that probabilities are known for the states of nature. Knowledge of the likelihood of each of the states of nature can play an important role in selecting a course of action. Thus, if a decision maker feels that a particular state of nature is highly likely, this will mean that the payoffs associated with that state of nature are also highly likely. This enables the decision maker to focus more closely on probable results of a decision. Consequently, probability estimates for the various states of nature can serve an important function if they can be obtained. Of course, in some situations, 1A present value is a lump sum payment that is the current equivalent to one or a set of future cash amounts using an assumed interest rate. 374 Part Two Stochastic Models accurate estimates of probabilities may not be available, in which case the decision maker may have to select a course of action without the benefit of probabilities. Decision Criterion The process of selecting one alternative from a list of alternatives is governed by a decision criterion, which embodies the decision maker's attitudes toward the decision as well as the degree of certainty that surrounds a decision. For instance, some decision makers are more optimistic, whereas others are more pessimistic. Moreover, some want to maximize gains, whereas others are more concerned with protecting against large losses. One example of a decision criterion is: "Maximize the expected payoff." Another example is: "Choose the alternative that has the best possible payoff." A variety of the most popular decision criteria are presented in the remainder of this chapter. TME PAYOFF TABLE A payoff table is a device a decision maker can use to summarize and organize information relevant to a particular decision. It includes a list of the alternatives, the possible future states of nature, and the payoffs associated with each of the alternative/state of nature combinations. If probabilities for the states of nature are available, these can also be listed. The general format of a payoff table is illustrated in Table 11—1. Table 11—1 General Format of a Decision Table State of nature S-| S2 S3 V11 V12 V^3 V21 v22 v23 V31 V32 V33 where a, = the /th alternative Sy = the y'th state of nature Vjj = the value or payoff that will be realized if alternative / is chosen and event; occurs Chapter 11 Decision Theory Table 11-2 Payoff Table for Real Estate Developer No Medium Large Center Center Center Residential Alternative Commercial #1 Commercial #2 $4 16 12 5 6 10 -1 4 15 A payoff table for the real estate developer's decision is shown in Table 11—2. The three alternatives under consideration are listed down the left side of the table and the three possible states of nature are listed across the top of the table. The payoffs that are associated with each of the alternative/ state-of-nature combinations are shown in the body of the table. Suppose that those values represent profits (or losses) in hundred thousand dollar amounts. Hence, if the residential proposal is chosen and no shopping center is built, the developer will realize a profit of $400,000. Similarly, if the second commercial proposal is selected and no center is built, the developer will lose $100,000. DECISION MAKING UNDER CERTAINTY The simplest of all circumstances occurs when decision making takes place in an environment of complete certainty. For example, in the case of the real estate problem, an unexpected early announcement concerning the building of the shopping center could reduce the problem to a situation of certainty. Thus, if there is an announcement that no shopping center will be built, the developer then can focus on the first column of the payoff table (see Table 11—3). Because the Commercial proposal #1 has the highest payoff in that column ($5), it would be selected. Similarly, if the announcement indicated that a medium-size shopping center is planned, only the middle column of the table would be relevant, and the residential alternative would be selected because its estimated payoff of 16 is the highest of the three payoffs for a medium size shopping center; whereas if a large center is planned, the developer could focus on the last column, selecting the Commercial #2 proposal because it has the highest estimated payoff of 15 in that column. In summary, when a decision is made under conditions of complete certainty, the attention of the decision maker is focused on the column in the payoff table that corresponds to the state of nature that will occur. The decision 376 Part Two Stochastic Models Table 11-3 If It Is Known that No Shopping Center Will Be Built, Only the First Column Payoffs Would Be Relevant Residential Commercial #1 Commercial #2 No Center Medium Center Large Center $4 16 12 5 6 10 1 4 15 maker then selects the alternative that will yield the best payoff, given that state of nature. DECISION MAKING UNDER COMPLETE UNCERTAINTY Under complete uncertainty, the decision maker either is unable to estimate the probabilities for the occurrence of the different states of nature, or else he or she lacks confidence in available estimates of probabilities, and for that reason, probabilities are not included in the analysis. Still another possibility is that the decision is a one-shot case, with an overriding goal that needs to be satisfied (e.g., a firm may be on the verge of bankruptcy and this might be the last chance to turn things around). Decisions made under these circumstances are at the opposite end of the spectrum from the certainty case just mentioned. We shall consider four approaches to decision making under complete uncertainty. They are: 1. Maximin. 2. Maximax. 3. Minimax regret. 4. Insufficient reason. The maximin strategy is a conservative one; it consists of identifying the worst (minimum) payoff for each alternative, and, then, selecting the alternative that has the best (maximum) of the worst payoffs. In effect, the decision maker is setting a floor on the potential payoff; the actual payoff cannot be less than this amount. For the real estate problem, the maximin solution is to choose the second alternative, Commercial #1, as illustrated in Table 11-4. Chapter 11 Decision Theory 377 Table 11—4 Maximin Solution for Real Estate Problem Residential Commercial #1 Commercial #2 No Center State of nature Medium Center Large Center Row Minimum $4 16 12 5 6 10 -1 4 15 Maximum Many people view the maximin criterion as pessimistic because they believe that the decision maker must assume that the worst will occur. In fact, if the minimum payoffs are all negative, this view is accurate. Others view the maximin strategy in the same light as a decision to buy insurance: protect against the worst possible events, even though you neither expect them nor want them to occur. The maximax approach is the opposite of the previous one: The best payoff for each alternative is identified, and the alternative with the maximum of these is the designated decision. For the real estate problem, the maximax solution is to choose the residential alternative, as shown in Table 11-5. Table 11-5 Maximax Solution for Real Estate Problem Residential Commercial #1 Commercial #2 No Center State of nature Medium Center Large Center $4 16 12 5 6 10 -1 4 15 Row Maximum 16 Maximum 10 15 Part Two Stochastic Models Just as the maximin strategy can be viewed as pessimistic, the maximax strategy can be considered optimistic, that is, choosing the alternative that could result in the maximum payoff. Both the maximax and maximin strategies can be criticized because they focus only on a single, extreme payoff and exclude the other payoffs. Thus, the maximax strategy ignores the possibility that an alternative with a slightly smaller payoff might offer a better overall choice. For example, consider this payoff table: State of nature S-) S2 S3 -5 16 -10 15 15 15 15 15 15 The maximax criterion would lead to selecting alternative ay even though two out of the three possible states of nature will result in negative payoffs. Moreover, both other alternatives will produce a payoff that is nearly the same as the maximum, regardless of the state of nature. A similar example could be constructed to demonstrate comparable weakness of the maximin criterion, which is also due to the failure to consider all payoffs. An approach that does take all payoffs into account is minimax regret. In order to use this approach, it is necessary to develop an opportunity loss table. The opportunity loss reflects the difference between each payoff and the best possible payoff in a column (i.e., given a state of nature). Hence, opportunity loss amounts are found by identifying the best payoff in a column and, then, subtracting each of the other values in the column from that payoff. For the real estate problem, the conversion of the orginal payoffs into an opportunity loss table is shown in Table 11-6. Hence, in column 1, the best payoff is 5; therefore, all payoffs are subtracted from 5 to determine the amount of payoff the decision maker would miss by not having chosen the alternative that would have yielded the best payoff if that state of nature occurs. Of course, there is no guarantee that it will occur. Similarly, the best payoff in the column 2 is 16, and all payoffs are Chapter 11 Decision Theory 379 Table 11-6 Opportunity Loss Table for Real Estate Problem Original Payoff Table Residential Commercial #1 Commercial #2 Best payoff in column No Medium Large Center Center Center $4 16 12 5 6 10 -1 4 15 16 15 Opportunity Loss Table Residential Commercial #1 Commercial #2 No Center Medium Center Large Center 5-4 = 1 16-16 =0 15-12 =3 5-5 =0 16-6 = 10 15-10 =5 5- -1 =6 16-4 = 12 15-15 =0 subtracted from that number to reflect the opportunity losses that would occur if a decision other than "Residential" was selected and a medium-size shopping center turned out to be the state of nature that comes to pass. Thus, for column 3, the opportunity costs evolve by subtracting each payoff from 15. Note that for every column, this results in a value of zero in the opportunity loss table in the same position as the best payoff for each column. For example, the best payoff in the last column of the payoff table is 15, and the corresponding position in the last column of the opportunity loss table is 0. The values in an opportunity loss table can be viewed as potential "regrets" Part Two Stochastic Models Table 11-7 Identifying the Minimax Regret Alternative Opportunity Losses No Medium Center Center Residential Commercial #1 Commercial #2 Large Maximum Center Loss 1 0 3 0 10 5 6 12 0 Minimum 10 12 that might be suffered as the result of choosing various alternatives. A decision maker could select an alternative in such a way as to minimize the maximum possible regret. This requires identifying the maximum opportunity loss in each row and, then, choosing the alternative that would yield the best (minimum) of those regrets. As illustrated in Table 11-7, for the real estate problem, this leads to selection of the "Residential" alternative. Although this approach has resulted in the same choice as the maximax strategy, the reasons are completely different; therefore, it is merely coincidence that the two yielded the same result. Under different circumstances, each can lead to selection of a different alternative. Although this approach makes use of more information than either maximin or maximax, it still ignores some information and, therefore, can lead to a poor decision. Consider, for example, the opportunity loss table illustrated in Table 11-8. Using minimax regret, a decision maker would be indifferent between alternatives a2 and a3, although ax would be a better choice because for all but one of the states of nature there would be no opportunity loss, and in the worst case, would result in an opportunity loss that exceeded the other worst cases by $1. Principle of Insufficient Reason The minimax regret criterion weakness is the inability to factor row differences. Hence, sometimes the minimax regret strategy will lead to a poor decision because it ignores certain information. The principle of insufficient reason offers a method that incorporates more of the information. It treats the states of nature as if each were equally likely, and it focuses on the average payoff for each row, selecting the alternative that has the highest row average. Chapter 11 Decision Theory 381 Table 11—8 Minimax Regret Can Lead to a Poor Decision a-i a2 a3 Si Opportunity Loss Table s2 S3 S4 s5 0 0 0 0 24 23 23 23 23 0 23 23 23 23 0 Worst in Row 24 23, 23' Minimum • Regret The payoff table from which the opportunity losses of Table 11—8 were computed is shown in Table 11—9, along with the row averages. Note how ax now stands out compared to the others. In fact, we could have obtained a similar result by finding the row averages for the opportunity loss table and, then, choosing the alternative that had the lowest average. Thus, the row averages for the opportunity losses presented in Table 11—8 are: Alternative Row Average ai a2 a3 4.8 18.4 18.4 Minimum Table 11-9 The Principle of Insufficient Reason a2 a3 Si s2 Payoff Table s3 s4 s5 28 28 28 28 4 5 5 5 5 28 5 5 5 5 28 Row Average 23.2 .375'to P(#2) < .67, and from there up to P(#2) = 1.0, Alternative a is best. In sum, the range of P(#2) over which each alternative is best is: For Alternative a; .67 < P(#2) < 1.0 For Alternative b: 0 < P(#2) < .375 For Alternative a .375 < P(#2) < .67 These ranges give the decision maker important insight on probability estimates. For example, a decision maker may be reluctant to specify an exact probabiHty for State of nature #2. However, with this information, the decision maker merely has to identify the most appropriate range for P(#2). Thus, if the decision maker believes that P(#2) is somewhere in the range of, say .80 to .90, according to the preceding calculations, Alternative a would be best. Or, if the decision maker believes that P(#2) lies close to .50, then Alternative c would be best. A similar analysis can be performed if the payoffs are costs or other values that are to be minimized rather than maximized. In such cases, the lowest line for a given value of P(#2) would be most desirable. An example of this is illustrated in the Solved Problems section at the end of this chapter. One final comment regarding the use of P(#2). It was mentioned previously that P(#2) is used for convenience. It happens that the equations of the lines are a bit easier to develop using P(#2) rather thanP(#l). However, should a problem refer to P(#l) ranges rather than P(#2), you can proceed by finding the ranges in terms of P(#2) and, then, converting these into P(#l) ranges as the final step. This merely involves recognizing thatP(#l) andP(#2) are complements. For example, ifP(#2) = 0, thenP(#l) = 1.0; if P(#2) = .40, then P(#l) = .60; and so on. Hence, if Alternative a is optimal for the range 0 = P(#2) < .40, then in terms of P(#l), Alternative a is optimal for the range .60 < P(# 1) = l.00. Figure 11-11 further illustrates this concept using the previous example. 400 Part Two Stochastic Models UTILITY Figure 11-11 Converting P(#2) Ranges into P(#l) Ranges P(#1) Throughout this chapter decision criteria have been illustrated that use monetary value as the basis of choosing among alternatives. Although monetary value is a common basis for decision making, it is not the only basis, even for business decisions. In certain instances, decision makers use multiple criteria, one of which is the potential satisfaction or dissatisfaction associated with possible payoffs. For example, a great many people participate in state lotteries. However, from a strict standpoint, lotteries have a negative expected value; the expected return is less than the cost of the lottery. If it were not, the states would lose money by running lotteries. Why do people play lotteries, then? The answer is that they are hoping to win a large amount of money, and they are willing to sacrifice a relatively small amount of money to have that chance. In other words, even though their chances of winning are close to zero, they have a greater utility for the potential winnings, despite a negative expected value, than for the amount of money they have to give up (pay) to participate in the lottery. Similar arguments can be made for other forms of wagering. People who behave in this fashion whether for purposes of wagering or in other forms of decision making, are sometimes referred to as risk takers. Just the opposite happens when a person buys insurance, giving up a fixed dollar amount to insure against an event (e.g., a fire) that has very little chance of occurring. Even so, if a fire or other insured event did occur, the consequences would be so catastrophic that an individual would not want to be exposed to that degree of risk. Thus, even though buying insurance carries a negative monetary value, most individuals recognize the merit of Chapter 11 Decision Theory 401 doing so. We refer to such individuals as risk averters. Of course, some individuals exhibit both forms of behavior in their decision making; they are risk takers for certain kinds of decisions but risk averters for others. A lottery player who owns a life insurance policy would be an example of this. Thus, utility is a measure of the potential satisfaction derived from money. Although utility can be an important factor in certain kinds of decision making, assessing and using utility values can be rather complex. Not only does utility vary within an individual for different types of situations, but it also seems to vary among individuals for the same situations. That is, different people might choose different alternatives in a given instance because of utility considerations. An expanded discussion of the topic of utility is beyond the scope of this text. Interested readers might want to consult some of the references listed for this chapter. UMMÄ3ŠT Decision theory is a general approach to decision making. It is very useful for a decision maker who must choose from a list of alternatives, knowing that one of a number of possible future states of nature will occur and that this will have an impact on the payoff realized by a particular alternative. Decision models can be categorized according to the degree of uncertainty that exists relative to the occurrence of the states of nature. This can range from complete knowledge about which state will occur to partial knowledge (probabilities) to no knowledge (no probabilities, or complete uncertainty). When complete uncertainty exists, the approach a decision maker takes in choosing among alternatives depends on how optimistic or pessimistic he or she is, and it also depends on other circumstances related to the eventual outcome or payoff. Under complete certainty, decisions are relatively straightforward. Under partial uncertainty, expected values often are used to evaluate alternatives. An extension of the use of expected values enables decision makers to assess the value of improved or perfect information about which state of nature will occur. Problems that involve a single decision are usually best handled through payoff tables, whereas problems that involve a sequence, or possible sequence, of decisions, are usually best handled using tree diagrams. Sometimes, decision makers can improve the decision process by taking into account additional (sample) information, which enables them to modify state of nature probabilities. Because there is almost always an additional cost associated with obtaining that sample information, the decision maker must decide whether the expected value of that information is worth the cost necessary to obtain it. Sensitivity analysis can sometimes be useful to decision makers, particularly for situations in which they find it difficult to accurately assess the probabilities of the various states of nature. Sensitivity analysis can help by providing 402 Part Two Stochastic Models ranges of probabilities for which a given alternative would be chosen, using expected monetary value as the criterion. Hence, the problem of specifying probabilities is reduced to deciding whether a probability merely falls within a range of values. Although expected monetary value is a widely used approach to decision making, certain individuals and certain situations may require consideration of utilities, which reflect how decision makers view the satisfaction associated with different monetary payoffs. Glossary decision criterion A standard or rule for choosing among alternatives (e.g., choose the alternative with the highest expected profit). decision tree A schematic representation of a decision problem that involves the use of branches and nodes. expected monetary value (EMV) For an alternative, the sum of the products of each possible payoff and the probability of that payoff. expected opportunity loss (EOL) For an alternative, the sum of the products of each possible regret and the probability of that regret. expected payoff under certainty (EPC) For a set of alternatives, the sum of products of the best payoff for each state of nature and that state's probability. expected regret {See expected opportunity loss.) expected value of perfect information (EVPI) The maximum additional benefit attainable if a problem involving risk could be reduced to a problem in which it was certain which state of nature would occur. Equal to the minimum expected regret. Also equal to EPC minus best EMV. expected value of sample information The expected benefit of acquiring sample information. Equal to the difference between the best EMV without information and the best EMV with information. maximax A decision criterion that specifies choosing the alternative with the best overall payoff. maximin A decision criterion that specifies choosing the alternative with the best of the worst payoffs for all alternatives. niinimax regret A decision criterion that specifies choosing the alternative that has the lowest regret (opportunity loss). opportunity loss For an alternative given a state of nature, the difference between that alternative's payoff and the best possible payoff for that state of nature. payoff table A table that shows the payoff for each alternative for each state of nature. principle of insufficient reason A decision criterion that seeks the alternative with the best average payoff, assuming all states of nature are equally likely to occur. Chapter 11 Decision Theory 403 regret {See opportunity loss.) risk A decision problem in which the states of nature have probabilities associated with their occurrence. state of nature Possible future events. uncertainty Refers to a decision problem in which probabilities of occurrence for the various states of nature are unknown. utility Of a payoff, a measure of the personal satisfaction associated with a payoff. SOLVED'PROBLEMS' 1. Given this profit payoff table: State of nature #1 #2 #3 a 12 18 15 Alternative c 17 22 10 16 14 10 d 14 14 14 Determine which alternative would be chosen using each of these decision criteria: a. Maximax. b. Maximin. c. Minimax regret. d. Principle of insufficient reason. Solution a. The maximax approach seeks the alternative that has the best overall payoff. Because these are profits, the best payoff would be the largest value, which is the payoff 22. Thus, in order to have a chance at that payoff, the decision maker should choose Alternative c. b. The maximin approach is to choose the alternative that will provide the best of the worst possible payoffs. To find this, first identify the worst profit possible for each alternative: Alternative Worst Payoff a 12 b 10 c 10 d 14 (best)