When you take a definite integral, you can think about calculating the area under the curve (via Riemann rectangle slices approximation)
Now, when you take the volume of a 3D object, you sum the slices.
Volume = summation of all the little slices' volumes = A(x) * width
But why are you just slapping an integral as a way to do the summation? Not seeing the connection between integral being "area under the curve" and suddenly integral being "summation" of the various areas of bases.

Area under the curve can be seen as a summation of small "volumes" of the type you alluded to: Namely the area under the curve is the sum of areas of rectangles of height $f(x)$ and small width when you split up your region of integration into small intervals, and evaluate $f(x)$ within each interval.