The following is the definition of lower semicontinuity:
Let $T$ be a topological space and $f:T\to\Bbb{R}\cup\{+\infty\}$ a function. $f$ is said to be lower semicontinuous if the set $\{x\in T:f(x)>a\}$ is open in $T$ for every $a\in\Bbb{R}$.
The Wikipedia article gives several examples. But I don't see why one would need the extanded value and how it would be useful. Could anyone come up with an example of lower semicontinuous function with the extended value $+\infty$ being assumed at some point in the domain? Why is the extended value useful in this definition?
Let $f$ be continuous and $K \subset T$ a closed subset, then
$$ f_K(x)= \begin{cases} f(x) & \text{if } x\in K \\ +\infty & \text{if } x\notin K \end{cases}$$
is a lower semicontinuous function as
$$\{ f_K >a\} = T\setminus K \cup \{ f>a\}.$$