Delayed optimization with Lagrangian multiplier

62 Views Asked by At

I am trying to solve an optimization problem with an objective function $$f(x)+h(y)$$ with constraints $$g(x)+y=0$$ Using the Lagrangian method the problem I cast the original constrained problem into an unconstrained problem as, $$\mathcal{L} (x,y,\lambda) = f(x)+h(y)-\lambda (g(x)+y)$$ But I would like to cast an optimization problem including a delayed update of Lagrangian multiplier in the objective function. Something like this, $$\mathcal{L} (x,y,\lambda) = f(x)+h(y)+j(\lambda_{i-1})-\lambda_{i} (g(x)+y)$$
where i-1 and i refers to variables from earlier and present steps of optimization. Can the Lagrangian variable be included in the objective function? I am confused since the Lagrange multiplier is the dual for the primal problem. Any suggestions appreciated.

1

There are 1 best solutions below

1
On

Perhaps a different approach may be more useful, although it is not what you are asking for.

Your constraint implies $y=-g(x)$ so now you are seeking to optimize $f(x) + h(-g(x))$, a regular one-variable optimization, which is usually qualitatively easier to deal with than the 2-variable problem.