First of all, I do not have much mathematical background and I have minimal category theory knowledge. I am just trying to understand one or two things about category theory because the concept sounds interesting. Please do not give answers like those in MacLane's book i.e answers for the working mathematician.
I understand that in Dual categories, all morphisms are essentially reversed.
For example having this Pullback in the category of sets, will reversing $p_1$ and $p_2$ leaving all the elements inside the set as they are and the functions represented by the morphisms $p_1$,$p_2$ also as is but just switching the domain and codomain make it a pushout?

A pullback is not just the diagram. It must also satisfy some properties:
The diagram must commute, in other words $f\circ p_1=g\circ p_2$.
[Universal property] $P$ must be such an object, that for any object C of the category, if there are morphisms $C\to X$ and $C\to Y$, then it must also have a unique morphism $C\to P$ and these morphisms must commute, again.
So, for the definition of a pushout, you have to reverse the direction of the morphisms not only at the diagram, but also at the properties. So, they become like this:
The (reversed) diagram must commute, in other words $p_1\circ f=p_2\circ g$.
[Universal property] $P$ must be such an object, that for any object C of the category, if there are morphisms $X\to C$ and $Y\to C$, then it must also have a unique morphism $P\to C$ and these morphisms must commute, again.