Upload
others
View
9
Download
0
Embed Size (px)
Citation preview
Research ArticleA General Setting and Solution ofBellman Equation in Monetary Theory
Xiaoli Gan and Wanbo Lu
School of Statistics, Southwestern University of Finance and Economics, Chengdu 610074, China
Correspondence should be addressed to Wanbo Lu; [email protected]
Received 28 September 2014; Revised 22 November 2014; Accepted 22 November 2014; Published 21 December 2014
Academic Editor: Zhihua Zhang
Copyright ยฉ 2014 X. Gan and W. Lu. This is an open access article distributed under the Creative Commons Attribution License,which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
As an important tool in theoretical economics, Bellman equation is very powerful in solving optimization problems of discrete timeand is frequently used in monetary theory. Because there is not a general method to solve this problem in monetary theory, it ishard to grasp the setting and solution of Bellman equation and easy to reach wrong conclusions. In this paper, we discuss the rulesand problems that should be paid attention to when incorporating money into general equilibrium models. A general setting andsolution of Bellman equation in monetary theory are provided. The proposed method is clear, is easy to grasp, is generalized, andalways leads to the correct results.
1. Introduction
In recent years, many economists applied business cycleapproaches to macroeconomic modeling so that monetaryfactors could be modeled into dynamic general equilibriummodels. As an important method of monetary economicsmodeling, infinite horizon representative-agent models pro-vide a close link between theory and practice; its researchframework can guide practice behavior and be tested byactual data. This method can link monetary economics andother popularmodels for studying business cycle phenomenaclosely.There are three basicmonetary economics approachesintroducing money to economic general equilibrium modelsin the infinite horizon representative-agent framework. First,it is assumed that utility could be yielded by money directlyso that the money variable has been incorporated into utilityfunction of the representative-agent models [1]. Second,assuming asset exchanges are costly, transaction costs of someform give rise to amoney demand [2, 3]. Clower [4] considersthat money is used for some types of transactions. Brock [5],McCallum and Goodfriend [6], and Croushore [7] assumethat time and money can be combined to yield transactionservices. Third, money is treated as an asset that can be usedto transfer resources between generations [8].
Dynamic optimization is the main involved issue duringthemodeling process. It is represented and solved by Bellmanequation method, namely, the value function method. Themethod will obtain a forward-looking householdโs path tomaximize lifetime utility through the optimal behavior andfurther relevant conclusions.The setting of Bellman equationis the first and crucial step to solve dynamic programmingproblems. It is hard to grasp the setting and solution ofBellman equation and easy to reach wrong conclusions sincethere is not a general method to set Bellman equation or thesettings of Bellman equation are excessively flexible. Walsh[9] used Bellman equation to set and solve dynamic generalequilibrium models of money. However he does not givea general law of Bellman equation setting. The setting andsolution of the equation in his book are ambiguous and notclear. To the best of the authorsโ knowledge, there have beenno studies of uniform setting of Bellman equation.
In this paper, we provide a set of general setting andsolution methods for Bellman equation with multipliers. Itis very clear and easy to grasp. The most important thing isthat the proposed method can always lead to correct results.We apply our method to monetary general equilibriummodels that are in the framework of the first two basicmonetary economic approaches which incorporate money
Hindawi Publishing CorporationJournal of Applied MathematicsVolume 2014, Article ID 495089, 9 pageshttp://dx.doi.org/10.1155/2014/495089
2 Journal of Applied Mathematics
into economic general equilibrium model and make someextensions. At the same time, we compare our method withother current methods of setting and solution for Bellmanequation to display the clarity and correctness of the proposedmethod. It is assumed that all the relevant assumptions ofapplying Bellman equation are satisfied. This is to ensure thefeasibility of analysis and solution. For the convenience ofdiscussion and suitable length of the paper, wemainly discussthe certainty linear programming problems. The Bellmanequationโs setting and solution of uncertainty problems aresimilar to those with certainty problems essentially.
2. A New Method of Setting and Solution ofBellman Equation
First of all, we provide the theoretical details of the newgeneral method and steps when applying Bellman equationto solve problems. It hasmany advantages.The relationship ofthe results is very clear through the connection ofmultipliers.There are no tedious expansions during the derivations. Itdiffers from the expansion method because it does not needto consider which control variable should be replaced. Thetechnical details about the equivalence of Bellman equationsand dynamic programming problems and the solvability ofset problems can be found in [10]. Actually, it is easy toreach wrong conclusions using other settings and solutionsof Bellman equation with multipliers, or it has to find someparticular skills to get the right results. But our methoddoes not meet the problem. The proposed method can bedescribed as the following five steps.
Step 1. List the expression of target problem.Consider the dynamic programming problem as
๐ป = maxโ
โ
๐ก=0
๐ฝ๐ก
โ (๐ฅ1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก) (1)
s.t.{{{
{{{
{
๐1(๐ฅ1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก, ๐ฅ๐+1,๐ก
, . . . , ๐ฅ๐๐ก) = 0, ๐ โค ๐,
.
.
.
๐๐(๐ฅ1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก, ๐ฅ๐+1,๐ก
, . . . , ๐ฅ๐๐ก) = 0, ๐ โค ๐,
(2)
where the objective function (1) represents the maximumsum of present value of a forward-looking behavioral agentโsevery period objective function โ(๐ฅ
1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก). In mon-
etary theory, โ(โ ) usually represents the utility function ofa family and ๐ฝ is a subjective rate of discount. Equation(2) is constraints; ๐
1(โ ), . . . , ๐
๐(โ ) are dynamic constraint
functions and usually are intertemporal budget constraints.Let control variables {๐ฅ
(๐)
1๐ก, ๐ฅ(๐)
2๐ก, . . . , ๐ฅ
(๐)
๐๐ก} โ {๐ฅ
1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก,
๐ฅ๐+1,๐ก
, . . . , ๐ฅ๐๐ก}; the remaining variables {๐ฅ
1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก,
๐ฅ๐+1,๐ก
, . . . , ๐ฅ๐๐ก} โ {๐ฅ
(๐)
1๐ก, ๐ฅ(๐)
2๐ก, . . . , ๐ฅ
(๐)
๐๐ก} = {๐ฅ
(๐ )
1๐ก, ๐ฅ(๐ )
2๐ก, . . . , ๐ฅ
(๐ )
๐๐ก} are
state variables.
Step 2. Set up Bellman equation with multipliers to expressdynamic optimization problem in Step 1:
๐(๐ฅ(๐ )
1๐ก, ๐ฅ(๐ )
2๐ก, . . . , ๐ฅ
(๐ )
๐๐ก)
= max {โ (๐ฅ1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก)
+ ๐ฝ๐ (๐ฅ(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1)}
+ ๐1๐ก๐1(๐ฅ1๐ก, . . . , ๐ฅ
๐๐ก, ๐ฅ๐+1,๐ก
, . . . , ๐ฅ๐๐ก)
+ โ โ โ + ๐๐๐ก
๐๐(๐ฅ1๐ก, . . . , ๐ฅ
๐๐ก, ๐ฅ๐+1,๐ก
, . . . , ๐ฅ๐๐ก) ,
(3)
where ๐(โ ) is the value function and ๐๐๐กis the multiplier of
the ๐th constraint ๐๐(โ ), ๐ = 1, 2, . . . , ๐.
Step 3. Compute the partial derivatives of all control variableson the right side of the equation at Step 2 to derive first-orderconditions:
๐๐ (๐ฅ(๐ )
1๐ก, ๐ฅ(๐ )
2๐ก, . . . , ๐ฅ
(๐ )
๐๐ก)
๐๐ฅ(๐)
๐๐ก
=
๐โ (๐ฅ1๐ก, ๐ฅ2๐ก, . . . , ๐ฅ
๐๐ก)
๐๐ฅ(๐)
๐๐ก
+ ๐ฝ[
[
๐๐ (๐ฅ(๐ )
1,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1)
๐๐ฅ(๐ )
1,๐ก+1
โ
๐๐ฅ(๐ )
1,๐ก+1
๐๐ฅ(๐)
๐๐ก
+ โ โ โ +
๐๐ (๐ฅ(๐ )
1,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1)
๐๐ฅ(๐ )
๐,๐ก+1
โ
๐๐ฅ(๐ )
๐,๐ก+1
๐๐ฅ(๐)
๐๐ก
]
]
+ ๐1๐ก
๐๐1(๐ฅ1๐ก, . . . , ๐ฅ
๐๐ก)
๐๐ฅ(๐)
๐๐ก
+ ๐๐๐ก
๐๐๐(๐ฅ1๐ก, . . . , ๐ฅ
๐๐ก)
๐๐ฅ(๐)
๐๐ก
= 0,
๐ = 1, 2, . . . , ๐.
(4)
During the derivation, it should be taken into accountthat next period state variables can be represented by othercontrol variables according to the constraints, that is, toexpand ๐ฅ
(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1. Because the constraints are
dynamic and are usually intertemporal budget constraints,those control variables ๐ฅ
(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1at time ๐ก +
1 can often be represented as expressions of the previ-ous period control variables. Attention should be paid tocompute the derivatives of control variables hiding in๐(๐ฅ(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1). But there is no need to expand
๐ฅ(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1after themultipliers during the deriva-
tion. Other than that, no particular attention should be paidto other current skills; for example, some control variablesshould be replaced after ๐ฅ
(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1represented
by other control variables in๐(๐ฅ(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1) and so
on.
Journal of Applied Mathematics 3
Step 4. By the envelope theorem, take the partial derivativesof control variables at time ๐ก on both sides of Bellmanequation to derive the remaining first-order conditions:
๐๐ (๐ฅ(๐ )
1๐ก, . . . , ๐ฅ
(๐ )
๐๐ก)
๐๐ฅ(๐ )
๐๐ก
= ๐1๐ก
๐๐๐(๐ฅ1๐ก, . . . , ๐ฅ
๐๐ก)
๐๐ฅ(๐ )
๐๐ก
+ โ โ โ + ๐๐๐ก
๐๐๐(๐ฅ1๐ก, . . . , ๐ฅ
๐๐ก)
๐๐ฅ(๐ )
๐๐ก
,
๐ = 1, 2, . . . , ๐.
(5)
Still, it does not need to expand ๐ฅ(๐ )
1,๐ก+1, ๐ฅ(๐ )
2,๐ก+1, . . . , ๐ฅ
(๐ )
๐,๐ก+1
after themultipliers during the derivations. Requirements arethe same as Step 3.
Step 5. Obtain the new relevant results about target problemthrough recursion and substitution according to the aboveresults.
We could combine several state variables to one asyou need according to specific economic significance andconstraints when there is no need to describe the relevanteconomic significance of state variables one by one. For exam-ple, ๐ฅ(๐ )1๐ก, ๐ฅ(๐ )2๐ก
could be combined as ๐(๐ฅ(๐ )
1๐ก, ๐ฅ(๐ )
2๐ก) = ๐ด
๐ก. ๐ด๐กis a
state variable in value function ๐(๐(๐ฅ(๐ )
1๐ก, ๐ฅ(๐ )
2๐ก), ๐ฅ(๐ )
3๐ก, . . . , ๐ฅ
(๐ )
๐๐ก),
that is, ๐(๐ด๐ก, ๐ฅ(๐ )
2๐ก, . . . , ๐ฅ
(๐ )
๐๐ก). And then we follow the above
five steps to solve specific problem. The rest of state variablescould be operated similarly. But combinations should notbe overlapped over state or combined state variables. Forinstance, suppose that ๐ฅ
(๐ )
1๐ก, ๐ฅ(๐ )
2๐กhave been combined as
๐(๐ฅ(๐ )
1๐ก, ๐ฅ(๐ )
2๐ก) = ๐ด
๐ก. It is inflexible to take ๐ฅ
(๐ )
2๐กas an independent
state variable in value function๐(๐ด๐ก, ๐ฅ(๐ )
2๐ก, . . . , ๐ฅ
(๐ )
๐๐ก) or put the
combination of ๐ฅ(๐ )
2๐ก, ๐ฅ(๐ )3๐ก, ๐(๐ฅ(๐ )1๐ก
, ๐ฅ(๐ )
2๐ก) = ๐ต
๐กin value function
๐(๐ด๐ก, ๐ต๐ก, . . . , ๐ฅ
(๐ )
๐๐ก) as a state variable.
The steps above give a general setting and solution ofBellman equation. These can be summarized as follows: first,set Bellman equation with multipliers of target dynamicoptimization problem under the requirement of no overlapsof state variables; second, extend the late period state variablesin ๐(โ ) on the right side of Bellman equation and there isno need to expand these variables after the multipliers; third,let the derivatives of state variables of time ๐ก equal zero andtake the partial derivatives of these variables on both sides ofBellman equation to derive first-order conditions; finally, getmore needed results for analysis from these conditions.
Different from some current settings which allow overlapof state variables in value function, our method does notpermit overlaps. In fact, overlap of state variable is easy toreach wrong conclusions or it has to find some particularskills to get the right results [9]. These methods are hard togeneralize. More details will be seen in the following sections.
Nowwewill take several discrete time dynamic optimiza-tion problems that are under framework of the basic twomethods of incorporating money into general equilibriummodels as examples to show the applications of our setting
and solution method and compare with current popularmethods.
3. Setting and Solution of Bellman Equation inBasic Money-In-Utility Model
3.1. Model and Solution Using Previous Approach. The basicMoney-In-Utility model has few features. The labor-leisureoptions of families are ignored temporarily in utility function.Only family consumption and real money balances areinvolved in utility function; that is, real money balances yieldutility directly. We ignore the uncertainty of currency impactand technological changes temporarily for convenience.
The total present utility value of family life cycle is๐ = โ
โ
๐ก=0๐ฝ๐ก
๐ข(๐๐ก, ๐๐ก). Usually the per capita version of
intertemporal budget constraint is
๐๐กโก ๐(
๐๐กโ1
1 + ๐) + ๐๐ก+ (
1 โ ๐ฟ
1 + ๐) ๐๐กโ1
+(1 + ๐๐กโ1
) ๐๐กโ1
+ ๐๐กโ1
(1 + ๐๐ก) (1 + ๐)
= ๐๐ก+ ๐๐ก+ ๐๐ก+ ๐๐ก,
(6)
where ๐๐ก, ๐๐ก, ๐๐ก, ๐๐ก, ๐๐ก, ๐๐กโ1
, and ๐๐กare the per capita
consumption, bonds, stock of capital, money balances, netlump-sum transfer received from the government, nominalinterest rate, and inflation rate, respectively, at time ๐ก. ๐ฟ is therate of depreciation of physical capital, ๐ is the populationgrowth rate (assumed to be constant), and ๐(๐
๐กโ1/(1 +
๐)) is the production function assumed to be continuouslydifferentiable and to satisfy the usual Inada conditions (see[11]). Note that control variables can be changed and affectthe total discounted value of utility through consumption ๐
๐ก
in period ๐ก; state variables cannot be changed. Determinationof state and control variables is crucial to derive the first-orderconditions and other results. The control variables for thisproblem are ๐
๐ก, ๐๐ก, ๐๐กand, ๐
๐กand the state variables are ๐
๐กโ1,
๐๐กโ1
,๐๐กโ1
, ๐๐ก, and๐
๐ก, the householdโs initial level of resources.
This problem can be solved by the expansion methodbelow according to Walsh [9]. It is started with setting upvalue function
๐ (๐๐ก) = max {๐ข (๐
๐ก, ๐๐ก) + ๐ฝ๐ (๐
๐ก+1)} . (7)
Using (6), value function can be expanded as
๐ (๐๐ก)
= max{๐ข (๐๐ก, ๐๐ก)
+ ๐ฝ๐(๐(๐๐ก
1 + ๐)
+ ๐๐ก+1
+ (1 โ ๐ฟ
1 + ๐) ๐๐ก
+(1 + ๐๐ก) ๐๐ก+ ๐๐ก
(1 + ๐๐ก+1
) (1 + ๐))} .
(8)
4 Journal of Applied Mathematics
Replace ๐๐กas ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก; according to (6), (8) can be
written as an expansion equation as follows:
๐ (๐๐ก) = max{๐ข (๐
๐ก, ๐๐ก)
+ ๐ฝ๐(๐(๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก
1 + ๐) + ๐๐ก+1
+ (1 โ ๐ฟ
1 + ๐) (๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก)
+(1 + ๐๐ก) ๐๐ก+ ๐๐ก
(1 + ๐๐ก+1
) (1 + ๐))} .
(9)
Compute the partial derivatives of control variables toderive first-order conditions:
๐๐ (๐๐ก)
๐๐๐ก
= ๐ข๐(๐๐ก, ๐๐ก) โ ๐๐(๐๐ก+1
)
โ ๐ฝ
1 + ๐โ [๐ (๐
๐ก) + 1 โ ๐ฟ] = 0,
๐๐ (๐๐ก)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
) โ 1 + ๐๐ก
(1 + ๐๐ก+1
) (1 + ๐)
โ ๐ฝ๐๐(๐๐ก+1
) [๐๐(๐๐ก) + 1 โ ๐ฟ
1 + ๐] = 0,
๐๐ (๐๐ก)
๐๐๐ก
= ๐ข๐
(๐๐ก, ๐๐ก) +
๐ฝ๐๐(๐๐ก+1
)
(1 + ๐๐ก+1
) (1 + ๐)
โ ๐ฝ๐๐(๐๐ก+1
) [๐๐(๐๐ก) + 1 โ ๐ฟ
1 + ๐] = 0,
(10)
and the envelope theorem yields
๐๐(๐๐ก) = ๐ข๐(๐๐ก, ๐๐ก) . (11)
Another expansionmethod will replace ๐๐กas๐๐กโ๐๐กโ๐๐กโ
๐๐ก; according to (6), (8) can be written as
๐ (๐๐ก) = max{๐ข (๐
๐กโ ๐๐กโ ๐๐กโ ๐๐ก, ๐๐ก)
+ ๐ฝ๐(๐(๐๐ก
1 + ๐) + ๐๐ก+1
+ (1 โ ๐ฟ
1 + ๐) ๐๐ก
+(1 + ๐๐ก) ๐๐ก+ ๐๐ก
(1 + ๐๐ก+1
) (1 + ๐))} .
(12)
Compute the partial derivatives of control variables toderive first-order conditions as
๐๐ (๐๐ก)
๐๐๐ก
= โ๐ข๐(๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก, ๐๐ก)
+ ๐ฝ๐๐(๐๐ก+1
) โ 1 + ๐๐ก
(1 + ๐๐ก+1
) (1 + ๐)= 0,
๐๐ (๐๐ก)
๐๐๐ก
= โ๐ข๐(๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก, ๐๐ก) + ๐๐(๐๐ก+1
)
โ ๐ฝ
1 + ๐โ [๐๐(๐๐ก) + 1 โ ๐ฟ] = 0,
๐๐ (๐๐ก)
๐๐๐ก
= โ๐ข๐(๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก, ๐๐ก)
+ ๐ข๐
(๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก, ๐๐ก)
+๐ฝ๐๐(๐๐ก+1
)
(1 + ๐๐ก+1
) (1 + ๐)= 0.
(13)
Using the envelope theoremand computing the derivativewith respect to state variable ๐
๐ก, we get
๐๐(๐๐ก) = ๐ข๐(๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก, ๐๐ก) . (14)
3.2. Our Solving Approach. Now, we use our proposed stepsof setting and solution of Bellman equation to solve theabove basic Money-In-Utility problem. First, let the Bellmanequation with multiplier ๐
๐กbe
๐ (๐๐ก) = max {๐ข (๐
๐ก, ๐๐ก) + ๐ฝ๐ (๐
๐ก+1)}
+ ๐๐ก(๐๐กโ ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก) .
(15)
Second, computing the partial derivatives for the controlvariables, we obtain the first-order conditions as
๐๐ (๐๐ก)
๐๐๐ก
= ๐ข๐(๐๐ก, ๐๐ก) = ๐๐ก,
๐๐ (๐๐ก)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
) โ 1 + ๐๐ก
(1 + ๐๐ก+1
) (1 + ๐)= ๐๐ก,
๐๐ (๐๐ก)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
) โ 1
1 + ๐โ [๐๐(๐๐ก) + 1 โ ๐ฟ] = ๐
๐ก,
๐๐ (๐๐ก)
๐๐๐ก
= ๐ข๐
(๐๐ก, ๐๐ก) + ๐ฝ๐
๐(๐๐ก+1
)
โ 1
(1 + ๐๐ก+1
) (1 + ๐)= ๐๐ก.
(16)
Third, using the envelope theorem and computing thederivatives of both sides of Bellman equation with respect tostate variable ๐
๐ก, we get
๐๐(๐๐ก) = ๐๐ก. (17)
Journal of Applied Mathematics 5
Finally, based on the above results, it is easy to get
๐ข๐(๐๐ก, ๐๐ก) = ๐๐ก= ๐ข๐
(๐๐ก, ๐๐ก)
+ ๐ฝ๐๐(๐๐ก+1
) โ 1
(1 + ๐๐ก+1
) (1 + ๐).
(18)
This expression indicates that the marginal benefit ofincreased money holdings should be equal to the marginalutility of consumption on period ๐ก. Similarly, we can easilyobtain the allocation of initial level of resources ๐
๐กamong
consumption, capital, bonds, and money balances, and thesame marginal benefit must be yielded by each use at anoptimum allocation.
These results with multiplier are open-and-shut, and it iseasy to find the economic significance of marginal utility ofconsumption. Comparing with current approach mentionedabove, during the process of solving problem, there is no needto consider which variable should be replaced. There are notedious expanded expressions. Using expansion method, ifwe replace ๐
๐ก, the derived first-order conditions are seen to
be messy and it is not easy to find the relationships of results.If we replace ๐
๐ก, the derived results are a bit more clear, but we
might not think of replacing ๐๐กat the beginning. So expansion
methods are not easy to operate, and it is not clear to replacevariable.
4. Setting and Solution of Bellman Equation inShopping-Time Model
4.1. Model and Solution Using Previous Approach. In Shop-ping-Time Model, shopping time is a function of consump-tion and money balances. Because consumption needs shop-ping time, leisure is reduced. Household utility is assumed todepend on consumption and leisure. Consumption can notonly yield utility directly but also decrease utility indirectly.In this section, ๐ is time spent in market employment and๐๐ is time spent shopping. ๐๐ is the function of consumption
and money balances; that is, ๐๐ = ๐(๐,๐), ๐๐
> 0, ๐๐
โค 0.Total time available is normalized to equal 1. Growth rate ofpopulation is assumed to be 0 for convenience. Let ๐ be theleisure time. The utility function is ๐ข(๐,๐, ๐) = V[๐, 1 โ ๐ โ
๐(๐, ๐)]. It donates utility as a function of consumption, laborsupply, and money holdings.
The householdโs intertemporal objective is maximumdiscounted utility subject to resource constraint as
maxโ
โ
๐=0
๐ฝ๐V (๐๐ก+๐
, 1 โ ๐๐ก+๐
โ ๐ (๐๐ก+๐
, ๐๐ก+๐
))
= maxโ
โ
๐=0
๐ฝ๐V (๐๐ก+๐
, ๐๐ก+๐
)
s.t. ๐ (๐๐กโ1
, ๐๐ก) + ๐๐ก+ (1 โ ๐ฟ) ๐
๐กโ1
+(1 + ๐๐กโ1
) ๐๐กโ1
+ ๐๐กโ1
1 + ๐๐ก
= ๐๐ก+ ๐๐ก+ ๐๐ก+ ๐๐ก.
(19)
Because controllable factors, labor supply, and consump-tion affect labor supply, output is affected not only by state
variable ๐๐กโ1
but also by these controllable factors. The leftside of the budget constraint is unsuitable to be combined asa state variable ๐
๐ก. Combining the money holdings, bonds,
and transfers to ๐๐ก= ๐๐ก+ (((1 + ๐
๐กโ1)๐๐กโ1
+ ๐๐กโ1
)/(1 + ๐๐ก)), the
householdโs financial assets, value function can be written as
๐ (๐๐ก, ๐๐กโ1
) = max {V (๐๐ก, ๐๐ก) + ๐ฝ๐ (๐
๐ก+1, ๐๐ก)} . (20)
According to Walsh [9], after replacing ๐๐ก+1
, ๐๐ก, value
function can be expanded as
๐ (๐๐ก, ๐๐กโ1
)
= max{V [๐๐ก, 1 โ ๐
๐กโ ๐ (๐
๐ก, ๐๐ก)]
+ ๐ฝ๐[๐๐ก+1
+(1 + ๐๐ก) ๐๐ก+ ๐๐ก
1 + ๐๐ก+1
, ๐ (๐๐กโ1
, ๐๐ก)
+ (1 โ ๐ฟ) ๐๐กโ1
+ ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก]} .
(21)
Computing the partial derivatives with respect to controlvariables, we get
๐๐ (๐๐ก, ๐๐กโ1
)
๐๐๐ก
= V๐[๐๐ก, 1 โ ๐
๐กโ ๐ (๐
๐ก, ๐๐ก)]
โ V๐[๐๐ก, 1 โ ๐
๐กโ ๐ (๐
๐ก, ๐๐ก)] ๐๐(๐๐ก, ๐๐ก)
โ ๐ฝ๐๐(๐๐ก+1
, ๐๐ก) = 0,
๐๐ (๐๐ก, ๐๐กโ1
)
๐๐๐ก
= โV๐[๐๐ก, 1 โ ๐
๐กโ ๐ (๐
๐ก, ๐๐ก)]
+ ๐ฝ๐๐(๐๐ก+1
, ๐๐ก) โ ๐๐(๐๐กโ1
, ๐๐ก) = 0,
๐๐ (๐๐ก, ๐๐กโ1
)
๐๐๐ก
= โV๐[๐๐ก, 1 โ ๐
๐กโ ๐ (๐
๐ก, ๐๐ก)] ๐๐
(๐๐ก, ๐๐ก)
+ ๐ฝ๐๐(๐๐ก+1
, ๐๐ก) โ
1
1 + ๐๐ก+1
โ ๐ฝ๐๐(๐๐ก+1
, ๐๐ก) = 0.
(22)
Computing the partial derivatives of both sides of thevalue equation with respect to the state variables ๐
๐ก, ๐๐กโ1
, weget
๐๐(๐๐ก, ๐๐กโ1
) = ๐ฝ๐๐(๐๐ก+1
, ๐๐ก)
๐๐(๐๐ก, ๐๐กโ1
) = ๐ฝ๐๐(๐๐ก+1
, ๐๐ก) [๐๐(๐๐กโ1
, ๐๐ก) + 1 โ ๐ฟ] .
(23)
4.2. Our Solving Approach. Now, we use our proposedmethod to solve the above Shopping-Time Model problem.First, let the Bellman equation with multiplier ๐
๐กbe
๐ (๐๐ก, ๐๐กโ1
) = max {V (๐๐ก, ๐๐ก) + ๐ฝ๐ (๐
๐ก+1, ๐๐ก)}
+ ๐๐ก[๐๐ก+ ๐ (๐
๐กโ1, ๐๐ก) + (1 โ ๐ฟ) ๐
๐กโ1
โ ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก] ,
(24)
6 Journal of Applied Mathematics
where state variable ๐๐ก+1
= ๐๐ก+1
+ (((1 + ๐๐ก)๐๐ก+๐๐ก)/(1 +๐
๐ก+1)).
Then, compute the partial derivatives with respect to controlvariables to derive first-order conditions,
๐๐ (๐๐ก, ๐๐กโ1
)
๐๐๐ก
= V๐(๐๐ก, ๐๐ก) โ V๐(๐๐ก, ๐๐ก) ๐๐(๐๐ก, ๐๐ก) = ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
, ๐๐ก) โ
1 + ๐๐ก
1 + ๐๐ก+1
= ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
, ๐๐ก) = ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
)
๐๐๐ก
= โV๐(๐๐ก, ๐๐ก) ๐๐
(๐๐ก, ๐๐ก) +
๐ฝ๐๐(๐๐ก+1
, ๐๐ก)
1 + ๐๐ก+1
= ๐๐ก.
(25)
Using the envelope theorem and computing the deriva-tives with respect to the state variables ๐
๐ก, ๐๐กโ1
, we get
๐๐(๐๐ก, ๐๐กโ1
) = ๐๐ก,
๐๐(๐๐ก, ๐๐กโ1
) = ๐๐ก[๐๐(๐๐กโ1
, ๐๐ก) + 1 โ ๐ฟ] .
(26)
Now, we use the above results to compute the opportunitycost of holding money. Since the utility function is
๐ข (๐, ๐, ๐) = V [๐, ๐ โ ๐ โ ๐ (๐,๐)] , (27)
and based on (6), (25), and (26), we obtain
๐ข๐
(๐๐ก, ๐๐ก, ๐๐ก)
๐ข๐(๐๐ก, ๐๐ก, ๐๐ก)
=โV๐(๐๐ก, ๐๐ก) ๐๐
(๐๐ก, ๐๐ก)
V๐(๐๐ก, ๐๐ก) โ V๐(๐๐ก, ๐๐ก) ๐๐(๐๐ก, ๐๐ก)
=๐๐กโ ((๐ฝ๐
๐(๐๐ก+1
, ๐๐ก)) / (1 + ๐
๐ก+1))
๐๐ก
= 1 โ((๐ฝ๐๐(๐๐ก+1
, ๐๐ก)) / (1 + ๐
๐ก+1))
๐ฝ๐๐(๐๐ก+1
, ๐๐ก) โ ((1 + ๐
๐ก) / (1 + ๐
๐ก+1))
= 1 โ1
1 + ๐๐ก
=๐๐ก
1 + ๐๐ก
.
(28)
Obviously, the expressions of the derived first-orderconditions by previousmethod seem to be tedious andmessy,and it is not so easy to compute the relevant results such as theopportunity cost of holding money. Our proposed methodis comparatively neat and can easily obtain relevant resultscorrectly.
5. Setting and Solution of Bellman Equation inCash-In-Advance Model
5.1. Model and Solution Using Previous Approach. In basicCash-In-Advance model, money is used to purchase goods.Money cannot yield utility itself, but the consumption offuture can yield utility. Svensson [12] assumed that agentsare available for spending only the cash carried over fromthe previous period.This is essentially different fromMoney-In-Utility model. Consider a simple form of discounted
household utility valueโโ
๐ก=0๐ฝ๐ก
๐ข(๐๐ก). More complicated utility
function will be discussed in the following sections. TakeCash-In-Advance constraint form as ๐
๐กโค (๐๐กโ1
/(1 + ๐๐ก)) + ๐๐ก
due to Svensson [12]. This means that the agent enters theperiod with money holdings ๐
๐กโ1and receives a lump-sum
transfer ๐๐ก(in real currency terms) for consumption goods.
Bonds and capital may not be purchased by currency. Ifcapital is assumed to be purchased by money, the Cash-In-Advance constraint will become (๐
๐กโ1/(1 + ๐
๐ก)) + ๐๐กโฅ ๐๐ก+ ๐๐ก.
The budget constraint is rewritten in real terms as
๐ (๐๐กโ1
) + ๐๐ก+ (1 โ ๐ฟ) ๐
๐กโ1
+(1 + ๐๐กโ1
) ๐๐กโ1
+ ๐๐กโ1
1 + ๐๐ก
โฅ ๐๐ก+ ๐๐ก+ ๐๐ก+ ๐๐ก.
(29)
In monetary theory, constraints are expressed as inequal-ity frequently. This constraint describes that the represen-tative agentโs time ๐ก real resources should be more thanor equal to the use of it, that is, purchasing consumption,capital, bonds, and money holdings that are then carried intoperiod ๐ก + 1. Because of the assumption of rational agents,the certainty problems we are discussing, and the positiveopportunity cost of money holdings, the constraints becomeequations in equilibriums.
Output is only affected by state variable ๐๐กโ1
withoutconsidering the effect of labor supply. Following the solutionmethods ofWalsh [9], let the left side of the budget constraintbe a state variable๐
๐ก= ๐(๐
๐กโ1)+๐๐ก+(1โ๐ฟ)๐
๐กโ1+(((1+๐
๐กโ1)๐๐กโ1
+
๐๐กโ1
)/(1 + ๐๐ก)). It will be very tedious adopting expansion
method with two constraints. Setting Bellman equation withmultipliers will be better. Let state variable ๐
๐กโ1in value
function get the economic significance of money in first-order conditions. However, there is an overlapped settingwith ๐
๐ก,
๐ (๐๐ก, ๐๐กโ1
) = max {๐ข (๐๐ก) + ๐ฝ๐ (๐
๐ก+1, ๐๐ก)}
+ ๐๐ก(๐๐กโ ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก)
+ ๐๐ก(
๐๐กโ1
1 + ๐๐ก
+ ๐๐กโ ๐๐ก) .
(30)
5.2. Our Solving Approach. Let ๐๐ก= ๐(๐
๐กโ1)+๐๐ก+(1โ๐ฟ)๐
๐กโ1+
(((1 + ๐๐กโ1
)๐๐กโ1
)/(1 + ๐๐ก)). There is no overlap with ๐
๐กin the
value function. The Bellman equation is set as
๐ (๐๐ก, ๐๐กโ1
) = max {๐ข (๐๐ก) + ๐ฝ๐ (๐
๐ก+1, ๐๐ก)}
+ ๐๐ก(๐๐ก+
๐๐กโ1
1 + ๐๐ก
โ ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก)
+ ๐๐ก(
๐๐กโ1
1 + ๐๐ก
+ ๐๐กโ ๐๐ก) .
(31)
The solution of this problem is similar to the applicationof the proposed method in Sections 3 and 4. We will not giveunnecessary details here.
Note that Walsh [9] puts overlapping state variables ๐๐กโ1
and๐๐กin value function; it is easy to get wrong results in those
Journal of Applied Mathematics 7
problems with Cash-In-Advance constraints although it is noproblem setting ๐(๐
๐ก, ๐๐กโ1
) with no more results requirednow. This will be seen in the following example of Section 6.
6. Setting and Solution of Bellman Equationin Model considering Both Labor Time andCash-In-Advance Constraints
6.1. Model and Solution Using Previous Approach. Assum-ing that money is used to purchase consumption goodsand investments, the Cash-In-Advance constraint becomes(๐๐กโ1
/(1 + ๐๐ก)) + ๐
๐กโฅ ๐๐ก+ ๐ฅ๐ก, where ๐ฅ is investment and
๐ฅ๐ก
= ๐๐กโ (1 โ ๐ฟ)๐
๐กโ1. In considering of the effects of labor
supply on output and leisure on utility, we have ๐๐ก
= 1 โ ๐๐ก.
The agentโs objective becomes
maxโ
โ
๐ก=0
๐ข (๐๐ก, ๐๐ก)
s.t. ๐ (๐๐กโ1
) + ๐๐ก+ (1 โ ๐ฟ) ๐
๐กโ1
+(1 + ๐๐กโ1
) ๐๐กโ1
+ ๐๐กโ1
1 + ๐๐ก
โฅ ๐๐ก+ ๐๐ก+ ๐๐ก+ ๐๐ก,
๐๐กโ1
1 + ๐๐ก
+ ๐๐กโฅ ๐๐ก+ ๐ฅ๐ก.
(32)
Output is affected not only by state variable ๐๐กโ1
but alsoby controllable factor ๐
๐ก; the left side of the budget constraint
is unsuitable to be combined as a state variable. Thinkingof the setting of the Shopping-Time Model and Cash-In-Advance model above, it is plausible to put overlapped statevariables ๐
๐ก= ๐๐ก+(((1+ ๐
๐กโ1)๐๐กโ1
+๐๐กโ1
)/(1+๐๐ก)) and๐
๐กโ1in
value function following the solution methods of Walsh [9].The Bellman equation will be
๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
= max {๐ข (๐๐ก, ๐๐ก) + ๐ฝ๐ (๐
๐ก+1, ๐๐ก, ๐๐ก)}
+ ๐๐ก[๐๐ก+ ๐ (๐
๐กโ1, ๐๐ก) + (1 โ ๐ฟ) ๐
๐กโ1
โ ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก]
+ ๐๐ก[๐๐กโ ๐๐กโ ๐๐ก+ (1 โ ๐ฟ) ๐
๐กโ1] .
(33)
The first-order conditions are๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ข๐(๐๐ก, ๐๐ก) = ๐๐ก+ ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
, ๐๐ก, ๐๐ก) โ
1 + ๐๐ก
1 + ๐๐ก+1
= ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
, ๐๐ก, ๐๐ก) = ๐๐ก+ ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐
(๐๐ก+1
, ๐๐ก, ๐๐ก)
+ ๐ฝ๐๐(๐๐ก+1
, ๐๐ก, ๐๐ก) โ
1
1 + ๐๐ก+1
= ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= โ๐ข๐(๐๐ก, ๐๐ก) + ๐๐ก๐๐(๐๐กโ1
, ๐๐ก) = 0.
(34)
Using the envelope theorem and computing the deriva-tives with respect to state variables, we get
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐๐(๐๐ก, ๐๐กโ1
, ๐๐กโ1
) = ๐๐ก+ ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐กโ1
= ๐๐(๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
= ๐๐ก[๐๐(๐๐กโ1
, ๐๐ก) + (1 โ ๐ฟ)]
+ ๐๐ก(1 โ ๐ฟ) ,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐กโ1
= ๐๐
(๐๐ก, ๐๐กโ1
, ๐๐กโ1
) = (๐๐ก+ ๐๐ก)
1
1 + ๐๐ก
.
(35)
When the question is to derive the effect of inflation rateon the steady-state capital-labor ratio, that is, the steady-state relationship of ๐๐ ๐ /๐๐ ๐ and ๐
๐ ๐ , assume that the aggregateproduction takes the form ๐ฆ
๐ก= ๐(๐
๐กโ1, ๐๐ก) = ๐ด๐
๐ผ
๐กโ1๐1โ๐ผ
๐ก.
Using (34) and (35),
๐ข๐(๐๐ก, ๐๐ก)
๐ข๐(๐๐ก, ๐๐ก)
=๐๐ก๐๐(๐๐กโ1
, ๐๐ก)
๐๐ก+ ๐๐ก
= ([๐ฝ๐๐
(๐๐ก+1
, ๐๐ก, ๐๐ก) + ๐ฝ๐
๐(๐๐ก+1
, ๐๐ก, ๐๐ก) โ
1
1 + ๐๐ก+1
]
ร ๐๐(๐๐กโ1
, ๐๐ก) ) (๐
๐ก+ ๐๐ก)โ1
= ([๐ฝ (๐๐ก+1
+ ๐๐ก+1
)1
1 + ๐๐ก+1
+ ๐ฝ (๐๐ก+1
+ ๐๐ก+1
)1
1 + ๐๐ก+1
]
ร ๐๐(๐๐กโ1
, ๐๐ก) ) (๐
๐ก+ ๐๐ก)โ1
= 2๐ฝ1
1 + ๐๐ก+1
๐๐(๐๐กโ1
, ๐๐ก) โ
๐๐ก+1
+ ๐๐ก+1
๐๐ก+ ๐๐ก
.
(36)
Then๐๐ก
๐๐ก+ ๐๐ก
= 2๐ฝ1
1 + ๐๐ก+1
๐๐ก+1
+ ๐๐ก+1
๐๐ก+ ๐๐ก
. (37)
From (35),
๐๐(๐๐กโ1
, ๐๐ก) =
๐๐(๐๐ก, ๐๐กโ1
, ๐๐กโ1
) โ (1 โ ๐ฟ) (๐๐ก+ ๐๐ก)
๐๐ก
= [1
๐ฝโ (1 โ ๐ฟ)]
๐๐ก+ ๐๐ก
๐๐ก
.
(38)
Rewriting the aggregate production as ๐๐
= ๐ผ๐ด(๐๐กโ1
/
๐๐ก)๐ผโ1, we have
๐๐ก
๐๐ก+ ๐๐ก
= (๐ผ๐ด)โ1
(๐๐กโ1
๐๐ก
)
1โ๐ผ
[1
๐ฝโ (1 โ ๐ฟ)] . (39)
8 Journal of Applied Mathematics
Using (37), we obtain
(๐ผ๐ด)โ1
(๐๐กโ1
๐๐ก
)
1โ๐ผ
[1
๐ฝโ (1 โ ๐ฟ)]
= 2๐ฝ1
1 + ๐๐ก+1
๐๐ก+1
+ ๐๐ก+1
๐๐ก+ ๐๐ก
.
(40)
Rewriting this equation, we get
๐๐กโ1
๐๐ก
= [2๐ฝ๐ผ๐ด
1 + ๐๐ก+1
(1
๐ฝโ 1 + ๐ฟ)
โ1
๐๐ก+1
+ ๐๐ก+1
๐๐ก+ ๐๐ก
]
1/(1โ๐ผ)
. (41)
In steady-state, ๐๐ก= ๐๐ก+1
= ๐๐ ๐ , ๐๐ก= ๐๐ก+1
= ๐๐ ๐ , ๐๐ก+1
=
๐๐ ๐ , ๐๐กโ1
= ๐๐ ๐ , ๐๐ก= ๐๐ ๐ , from (41), we have
๐๐ ๐
๐๐ ๐
= [1 + ๐๐ ๐
2๐ผ๐ฝ(
1
๐ฝโ 1 + ๐ฟ)]
1/(๐ผโ1)
. (42)
This steady-state capital-labor ratio is derived by usingcurrent prevailing methods. However, it is a wrong result. Wewill provide the correct result by using the proposed methodof this paper.
6.2. Our Solving Approach. Output is affected by state vari-able ๐
๐กโ1and control variable ๐
๐ก; it is unsuitable to let the left
side of the budget constraint be combined as a state variable.We should separate ๐
๐กโ1from it. Let state variable ๐
๐กโ1in
value function alone get the economic significance of moneyin first-order conditions. Because overlaps of state variablesare not allowed according to our proposed method, we put๐๐ก= ๐๐ก+ (((1 + ๐
๐กโ1)๐๐กโ1
)/(1 + ๐๐ก)) in value function as a state
variable.First, set up value function with multipliers:
๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
= max {๐ข (๐๐ก, ๐๐ก) + ๐ฝ๐ (๐
๐ก+1, ๐๐ก, ๐๐ก)}
+ ๐๐ก[๐๐ก+
๐๐กโ1
1 + ๐๐ก
+ ๐ (๐๐กโ1
, ๐๐ก)
+ (1 โ ๐ฟ) ๐๐กโ1
โ ๐๐กโ ๐๐กโ ๐๐กโ ๐๐ก]
+ ๐๐ก[๐๐กโ
(1 + ๐๐กโ1
) ๐๐กโ1
1 + ๐๐ก
+๐๐กโ1
1 + ๐๐ก
โ ๐๐กโ ๐๐ก+ (1 โ ๐ฟ) ๐
๐กโ1] .
(43)
Second, compute the derivatives of state variables andderive first-order conditions:
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ข๐(๐๐ก, ๐๐ก) = ๐๐ก+ ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
, ๐๐ก, ๐๐ก) โ
1 + ๐๐ก
1 + ๐๐ก+1
= ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐(๐๐ก+1
, ๐๐ก, ๐๐ก) = ๐๐ก+ ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐ฝ๐๐
(๐๐ก+1
, ๐๐ก, ๐๐ก) = ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= โ๐ข๐(๐๐ก, ๐๐ก) + ๐๐ก๐๐(๐๐กโ1
, ๐๐ก) = 0.
(44)
Third, compute the partial derivatives with respect to ๐๐ก,
๐๐กโ1
, and ๐๐กโ1
and the envelope theorem yields
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐ก
= ๐๐(๐๐ก, ๐๐กโ1
, ๐๐กโ1
) = ๐๐ก+ ๐๐ก,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐กโ1
= ๐๐(๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
= ๐๐ก[๐๐(๐๐กโ1
, ๐๐ก) + (1 โ ๐ฟ)] + ๐
๐ก(1 โ ๐ฟ) ,
๐๐ (๐๐ก, ๐๐กโ1
, ๐๐กโ1
)
๐๐๐กโ1
= ๐๐
(๐๐ก, ๐๐กโ1
, ๐๐กโ1
) = (๐๐ก+ ๐๐ก)
1
1 + ๐๐ก
.
(45)
Finally, derive the steady-state capital-labor ratio by theresults above:
๐๐ ๐
๐๐ ๐
= [1 + ๐๐ ๐
๐ผ๐ฝ(
1
๐ฝโ 1 + ๐ฟ)]
1/(๐ผโ1)
. (46)
The process of deriving this ratio is similar to thederiving process of (42). We will not give unnecessarydetails here. Compare (46) with (42); the result of (42) is(1/2)1/(๐ผโ1) times that of (46). Equation (46) is the correct
result. It is the different partial derivatives with respectto ๐๐กin (34) and (44) that cause this deviation. In (34),
๐ฝ๐๐(๐๐ก+1
, ๐๐ก, ๐๐ก) + ๐ฝ๐
๐(๐๐ก+1
, ๐๐ก, ๐๐ก) โ (1/(1 + ๐
๐ก+1)) = ๐
๐ก. In
(44), ๐ฝ๐๐(๐๐ก+1
, ๐๐ก, ๐๐ก) = ๐
๐ก. Fundamentally speaking, the
reason for the deviation is the overlapped setting of statevariables ๐
๐กand๐
๐กโ1versus the nonoverlapped setting of state
variables ๐๐ก, ๐๐กโ1
, and๐๐กโ1
. One has to use the particular skillsin [9] that is hard to think about and grasp to obtain the rightanswer or get a wrong result adopting the overlapped setting๐(๐๐ก, ๐๐กโ1
, ๐๐กโ1
). For this reason, the setting of value functionbyWalsh could not be generalized. In this model consideringboth Labor Time and Cash-In-Advance constraints, the basicmethods of incorporating money into general equilibriummodels are generalized, and our proposed method of setting
Journal of Applied Mathematics 9
and solution of Bellman equation demonstrates its clarityand validity and corrects the defect that some other currentmethods of setting and solution are easy to get wrong results.
7. Conclusions
As an important tool in theory economics, Bellman equationis very powerful in solving optimization problems of discretetime and is frequently used in monetary theory. It is hard tograsp the setting and solution of Bellman equation and easy toreach wrong conclusions since there is no general method toset Bellman equation or the settings of Bellman equation areexcessively flexible. In this paper, we provide a set of generalsetting and solution methods for Bellman equation withmultipliers. In the processes of solving monetary problems,comparing with other current methods in classic reference,our proposed method demonstrates its features of clarity,validity, correct results, easy operation, and generalization.Bellman equation is used not only in monetary problemsbut also in almost every dynamic programming problemassociated with discrete time optimization. Our future workis to study the applicability of the proposed method in thispaper in other areas.
Conflict of Interests
The authors declare that there is no conflict of interestsregarding the publication of this paper.
Acknowledgments
Wanbo Luโs research is sponsored by the National ScienceFoundation of China (71101118) and the Program for NewCentury Excellent Talents in University (NCET-13-0961) inChina.
References
[1] M. Sidrauski, โRational choice and patterns of growth in amon-etary economy,โ American Economic Review, vol. 57, no. 2, pp.534โ544, 1967.
[2] W. Baumol, โThe transactions demand for cash,โQuarterly Jour-nal of Economics, vol. 67, no. 4, pp. 545โ556, 1952.
[3] J. Tobin, โThe interest elasticity of the transactions demand forcash,โ Review of Economics and Statistics, vol. 38, no. 3, pp. 241โ247, 1956.
[4] R. W. Clower, โA reconsideration of the microfoundations ofmonetary theory,โ Western Economic Journal, vol. 6, no. 1, pp.1โ9, 1967.
[5] W. A. Brock, โMoney and growth: the case of long run perfectforesight,โ International Economic Review, vol. 15, pp. 750โ777,1974.
[6] B. T. McCallum and M. S. Goodfriend, โDemand for money:theoretical studies,โ in The New Palgrave Dictionary of Eco-nomics, pp. 775โ781, Palgrave MacMillan, Houndmills, UK,1987.
[7] D. Croushore, โMoney in the utility function: functional equiv-alence to a shopping-time model,โ Journal of Macroeconomics,vol. 15, no. 1, pp. 175โ182, 1993.
[8] P. A. Samuelson, โAn exact consumption-loan model of interestwith or without the social contrivance of money,โ Journal ofPolitical Economy, vol. 66, no. 6, pp. 467โ482, 1958.
[9] C. E. Walsh, Monetary Theory and Policy, The MIT Press,Cambridge, Mass, USA, 3rd edition, 2010.
[10] L. Gong,OptimizationMethods in Economics, PekingUniversityPress, Beijing, China, 2000.
[11] D. Romer,AdvancedMacroeconomics, McGraw-Hill, New York,NY, USA, 4th edition, 2011.
[12] L. E. O. Svensson, โMoney and asset prices in a cash-in-advanceeconomy,โ Journal of Political Economy, vol. 93, no. 5, pp. 919โ944, 1985.
Submit your manuscripts athttp://www.hindawi.com
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
MathematicsJournal of
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Mathematical Problems in Engineering
Hindawi Publishing Corporationhttp://www.hindawi.com
Differential EquationsInternational Journal of
Volume 2014
Applied MathematicsJournal of
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Probability and StatisticsHindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Journal of
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Mathematical PhysicsAdvances in
Complex AnalysisJournal of
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
OptimizationJournal of
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
CombinatoricsHindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
International Journal of
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Operations ResearchAdvances in
Journal of
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Function Spaces
Abstract and Applied AnalysisHindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
International Journal of Mathematics and Mathematical Sciences
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
The Scientific World JournalHindawi Publishing Corporation http://www.hindawi.com Volume 2014
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Algebra
Discrete Dynamics in Nature and Society
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Decision SciencesAdvances in
Discrete MathematicsJournal of
Hindawi Publishing Corporationhttp://www.hindawi.com
Volume 2014 Hindawi Publishing Corporationhttp://www.hindawi.com Volume 2014
Stochastic AnalysisInternational Journal of