Is it true that all boundary problems (ODE's n-order, PDE's, etc.) in any dimension always have an unique solution (if a solution exists)? If not, what are some counterexamples to this? Furthermore, is there a general set of restrictions that will allow the uniqueness of solution (ODE, PDE, etc.). For example, forcing both the derivative and the position function to have certain values at the boundary, or required the solution to be infinitely smooth and the space compact. Maybe it has to do with weak derivative, etc.
My intuition is that the answer should be no. Suppose two non-identical solutions for the BVP exist. Then I can "follow" both equations "out" (away) from the Boundary to a point where they differ. This means the vector field points in two directions at this point, which is not allowed to happen as learned in elementary differential equation.
Thank you.
Your question is equivalent to the question which boundary value problems (ODEs or PDEs) are well posed, in the sense of Hadamard. To this question alone, a major part of PDE research has been devoted for the last century or so, especially in the case of boundary conditions which are considered to be physically meaningful. To quote Wikipedia's lemma on boundary value problems:
A famous example is the question when the Navier-Stokes equations possess a global, smooth solution; it is one of the one million dollar Clay Institute problems. For more thoughts on the issue of uniqueness for this particular problem, see here. For some recent well-posedness results for the Navier-Stokes equations, see here.
Even in the ODE setting, the question of uniqueness related to boundary conditions is a difficult one. Quoting Scholarpedia's lemma on boundary value problems, which focuses exclusively on the ODE context:
I hope this helps!