If we want to choose $\mathbf{u}(t)$ in order to minimize $$ J(\mathbf{x}(t),t) = \int_{t}^{T} g(\mathbf{x}(s),\mathbf{u}(s),s) \, \textrm{d}s + h(\mathbf{x}(T),T), $$ subject to $ \dot{\mathbf{x}}(t) = \mathbf{a}(\mathbf{x}(t),\mathbf{u}(t),t), $ then the Hamilton–Jacobi–Bellman (HJB) equation tells us that the optimal $J^{*}(x(t),t)$ satisfies: $$ 0 = \frac{\partial J^{*}}{\partial t}(\mathbf{x}(t),t) + \min_{\mathbf{u}(t)} \Big\{ \, g(\mathbf{x}(t),\mathbf{u}(t),t) + \frac{\partial J^{*}}{\partial \mathbf{x}}(\mathbf{x}(t),t) \cdot \mathbf{a}(\mathbf{x}(t),\mathbf{u}(t),t) \, \Big\}. $$ Sometimes in economics papers, where $g(\mathbf{x}(t),\mathbf{u}(t),t) = \textrm{e}^{-\rho t} \cdot \tilde{g}(\mathbf{x}(t),\mathbf{u}(t),t)$, and when $T=\infty$, I see the HJB equation written as: $$ \frac{\partial J^{*}}{\partial t}(\mathbf{x}(t),t) = -\rho J^{*}(\mathbf{x}(t),t). $$ When is this okay to do?
2026-03-25 22:10:18.1774476618
Hamilton–Jacobi–Bellman equation under exponential discounting
121 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail AtRelated Questions in ECONOMICS
- Total savings from monthly deposits
- Calculus problem from a book of economics.
- a risk lover agent behave as if risk natural.
- Changes in the mean absolute difference (relating to the Gini coefficient)
- Absurd differential in first order condition
- FM Actuary question, comparing interest rate and Discount rate
- How do I solve for the selling price?
- Stochastic Dynamic Programming: Deriving the Steady-State for a Lottery
- A loan is to be repaid quarterly for five years that will start at the end of two years. If interest rate is $6$%..
- A cash loan is to be repaid by paying $13500$ quarterly for three years starting at the end of four years. If the interest rate is $12$%
Related Questions in STOCHASTIC-DIFFERENTIAL-EQUATIONS
- Polar Brownian motion not recovering polar Laplacian?
- Uniqueness of the parameters of an Ito process, given initial and terminal conditions
- $dX_t=\alpha X_t \,dt + \sqrt{X_t} \,dW_t, $ with $X_0=x_0,\,\alpha,\sigma>0.$ Compute $E[X_t] $ and $E[Y]$ for $Y=\lim_{t\to\infty}e^{-\alpha t}X_t$
- Initial Distribution of Stochastic Differential Equations
- (In)dependence of solutions to certain SDEs
- Expectation, supremum and convergence.
- Integral of a sum dependent on the variable of integration
- Solving of enhanced Hull-White $dX_t = \frac{e^t-X_t}{t-2}dt + tdW_t$
- Closed form of a SDE
- Matricial form of multidimensional GBM
Related Questions in OPTIMAL-CONTROL
- Do I really need quadratic programming to do a Model Predictive Controller?
- Transforming linear dynamical system to reduce magnitude of eigen values
- Hamiltonian minimization
- An approximate definition of optimal state trajectory of a discrete time system
- Reference request: Symmetric Groups and linear control systems
- Does the Pontryagrin maximum principle in sequential order result in same minimum?
- I can't get my Recursive Least Square algorithm work - What have I miss?
- Will LQR act like MPC in reality?
- Find which gain the process will be unstable?
- How do I find the maximum gain limit for a delayed system?
Related Questions in HAMILTON-JACOBI-EQUATION
- Solution of an HJB equation in continuous time
- Uniqueness of weak solutions of the Hamilton-Jacobi Equation (Evans proof)
- Coherence between Hamiltonian and Lagrangian in form of an inequality (Evans PDE)
- Numerical Solution to Hamilton-Jacobi-Bellman
- How do I further constrain the Hamilton-Jacobi-Bellman equation to find the optimal control?
- Weak solutions of initial value problem of conservation laws with $L^{\infty}$ initial data
- How to take partial derivative with respect to a derivative?
- How do we know the solutions to the Hamilton Jacobi equation are seperable?
- IVP for nonlinear PDE $u_t + \frac{1}{3}{u_x}^3 = -cu$
- Estimate the large-time behavior of the unique viscosity solution
Trending Questions
- Induction on the number of equations
- How to convince a math teacher of this simple and obvious fact?
- Find $E[XY|Y+Z=1 ]$
- Refuting the Anti-Cantor Cranks
- What are imaginary numbers?
- Determine the adjoint of $\tilde Q(x)$ for $\tilde Q(x)u:=(Qu)(x)$ where $Q:U→L^2(Ω,ℝ^d$ is a Hilbert-Schmidt operator and $U$ is a Hilbert space
- Why does this innovative method of subtraction from a third grader always work?
- How do we know that the number $1$ is not equal to the number $-1$?
- What are the Implications of having VΩ as a model for a theory?
- Defining a Galois Field based on primitive element versus polynomial?
- Can't find the relationship between two columns of numbers. Please Help
- Is computer science a branch of mathematics?
- Is there a bijection of $\mathbb{R}^n$ with itself such that the forward map is connected but the inverse is not?
- Identification of a quadrilateral as a trapezoid, rectangle, or square
- Generator of inertia group in function field extension
Popular # Hahtags
second-order-logic
numerical-methods
puzzle
logic
probability
number-theory
winding-number
real-analysis
integration
calculus
complex-analysis
sequences-and-series
proof-writing
set-theory
functions
homotopy-theory
elementary-number-theory
ordinary-differential-equations
circles
derivatives
game-theory
definite-integrals
elementary-set-theory
limits
multivariable-calculus
geometry
algebraic-number-theory
proof-verification
partial-derivative
algebra-precalculus
Popular Questions
- What is the integral of 1/x?
- How many squares actually ARE in this picture? Is this a trick question with no right answer?
- Is a matrix multiplied with its transpose something special?
- What is the difference between independent and mutually exclusive events?
- Visually stunning math concepts which are easy to explain
- taylor series of $\ln(1+x)$?
- How to tell if a set of vectors spans a space?
- Calculus question taking derivative to find horizontal tangent line
- How to determine if a function is one-to-one?
- Determine if vectors are linearly independent
- What does it mean to have a determinant equal to zero?
- Is this Batman equation for real?
- How to find perpendicular vector to another vector?
- How to find mean and median from histogram
- How many sides does a circle have?