Define the function $f:[0,1]\to\mathbb R$ by $$f(x) = \left\{\begin{matrix} 0 \qquad &\text{if} &\qquad x=0\\ 1/x \qquad &\text{if} &\qquad x\neq 0. \end{matrix}\right.$$
$f$ is not bounded, so it is not Riemann integrable. However, we can still try to make sense of the limit of the Riemann sums. It seems very likely to me that the Riemann sums will converge to $\infty$, with the limit taken in the same sense as for the Riemann integral of Riemann-integrable functions, namely, that for every sequence of tagged partitions ${D_n}$ of $[0,1]$ such that the mesh size $\nu(D_n)\to 0$ as $n\to\infty$ we have that the limit of the Riemann-sums satisfies $$\lim_{n\to\infty}\sum_{i=1}^{m}f(\xi_i)\Delta x_i = \infty.$$ Here I have represented the tagged partition $D_n$ as $D_n = \{x_0=0\leq \xi_1\leq x_1\leq\dots\leq \xi_m\leq x_m = 1 \}$ (where all $\xi_i$ and $x_i$, and also the $m$ appearing in the sum, depend on $n$, but I have ommitted this for clarity).
Question: Is this correct? And most importantly, how do we prove this?
I'm not 100% sure the result is true but it seems very likely to me. In that case it would make sense to say that $\int_0^1f(x)\text{d} x = \infty$ even though the function is not Riemann-integrable. I have been trying to prove it but did not succeed yet. It's tempting to just use the fact that $\int_{1/m}^1f(x) = -\log(1/m)$ and then take the limit $m\to\infty$. However, this is a different definition of the integral, and it is not obvious at all that it should be equivalent to the definition of the integral that I gave above.
My (unsuccessful) idea was to split the integral as $\int_0^1f(x)\text{d} x = \int_0^{\lambda}f(x)\text{d} x + \int_\lambda^1f(x) \text d x$ (this is symbolic, we should do this split in the Riemann sums), taking a small $\lambda$. Then if we have a partition of $[0,1]$ containing $\lambda$ as one of its points $x_k$, and with sufficiently small mesh size, then the second integral (actually the corresponding Riemann sum) becomes arbitrarily close to $-\log\lambda$, and the first integral (actually the corresponding Riemann sum) is always positive, so the complete expression is always larger than $-\log\lambda$. Hence taking $\lambda\to 0$ this would seem to indicate that we can make the Riemann sums arbitrarily large, hence the integral would converge to $\infty$. The problem with this argument is of course that I have assumed beforehand that the partition contains $\lambda$ as one of its points $x_k$. We need the limit to give the same result for any partition, however, and not only for those ones containing $\lambda$. Now, it is true that $\lambda$ was arbitrary, so our conclusion that the total Riemann sum can be made arbitrarily large holds in some sense for all partitions, but the $\delta$ that we need in order to achieve this depends on $\lambda$, which is not what we want.
Any ideas?
I think you were close to a solution with the idea of splitting the domain. To fill the gap: suppose you have some $R > 0$. Then there exists $\delta_0 > 0$ such that $-\log(\delta_0) \ge 2 R$. Now, for any partition $(x_i, x_i^*)$ with norm less than $\delta_0$, we can form an "intersection partition" where the first interval starts at $\delta_0$, we take the subset of interval endpoints which are greater than $\delta_0$, and we choose either the corresponding $x_i^*$ from the original partition or replace -- or if that corresponding $x_i^*$ for the original interval containing $\delta_0$ was less than $\delta_0$, then we replace that one with $\delta_0$. The Riemann sum for the original partition is greater than the Riemann sum for the intersection partition of $\int_{\delta_0}^1 \frac{dx}{x} = -\log(\delta_0)$; and the norm of the intersection partition is at most the norm of the original partition. Since $\frac{1}{x}$ is continuous on $[\delta_0, 1]$, the limit of these lower bounds for the full Riemann sum, as $\delta \to 0^+$, is equal to $-\log(\delta_0) \ge 2 R$. Therefore, for small enough $\delta > 0$, we can conclude that the full Riemann sum is greater than $R$ for any partition of $[0, 1]$ with norm less than $\delta$.
(Note that this argument made essential use of the fact that $f$ is positive and decreasing on $(0, 1]$. It could be interesting to see whether there might be a situation for something like $\int_0^1 \frac{1}{x^2} \sin(1/x)\,dx$ where the integral diverges, but where some subset of Riemann sums might converge. Maybe by having the lower part of the partition always having $x_i^*$ being of the form $\frac{1}{n\pi}$ with $n\in \mathbb{N}$, and taking splitting points also at $\frac{1}{m\pi}$ so that the integral from that point to 1 is equal to 0?)