If I know the orthographic projections of a given solid in Euclidean 3-space onto the $xy$, $xz$ and $yz$ planes, under which circumstances can I reconstruct the solid based on that information alone?
Clearly, it is necessary that the solid be convex, otherwise it might have inside surfaces that are not visible from the outside at all and thus will not leave a mark in any of the projections. But is that also sufficient?
This mathoverflow question is related: Is the sphere the only surface all of whose projections are circles?
In particular, they give an example of two distinct objects which have the exact same set of orthogonal projections (i.e. every projection of one is a projection of the other in some, possibly different direction).
This can be adapted for your situation; in fact, it's even simpler. Cutting off cross caps in the first octant from a sphere does not change any of the three projections.
Edit: The paper "How Many 2D Silhouettes Does It Take to Reconstruct a 3D Object?" by Aldo Laurentini examines this question in great deal, including describing families of surfaces that are exactly reconstructible from their sillhouettes.