I'm having a difficult time visualising it...
If we make it non biconnected, thus removing all vertices which give us alternative paths from 1 vertex to another, and with all vertices belonging to the outer face of the graph, wouldn't this be a tree?
Here's a counterexample from the Wikipedia page of ”biconnected graph”.