Evidence of Absence = Absence of Evidence?

1.7k Views Asked by At

Any clever-cloggs out there who can explain the formula below in more simple English please? - Do you agree with the formula?

absence of evidence is evidence of absence

4

There are 4 best solutions below

4
On BEST ANSWER

As far as I can make out, it's just mincing words. Logical negation is not a good representation of what "absence" means. I'll assume that it is standard to describe the observation of $A$ as "evidence"; given the conditions of the poster this seems to be at least somewhat reasonable. However, then "absence of evidence" does not mean observing $\neg A$. It simply means that we're not observing $A$ -- which could be because both $A$ and $\neg A$ are events that cannot be, or have not been, observed directly.

"Absence of evidence" can also be taken to describe the situation that we can identify no random observable that is even (provably) dependent of $B$. This too is very different from observing such a variable and find that it doesn't support $B$.

In essence, the author is committing the very fallacy he's denying. He's assuming that the phrase "absence of evidence" ought to be modeled mathematically as a construction that actually models presence of evidence to the contrary.

Or, in modal logic terms, $\neg \Box A$ is not the same as $\Box \neg A$.

(Since no post is complete without a bad analogy: Consider A="it is raining" and B="the train will be crammed full". A is indeed "evidence" of B in the poster's sense, because when the weather is bad more people will be likely to take the train instead of cycling to work. Then "evidence" would be looking out the window and seeing it pour down, in which case could validly conclude that the risk of a full train is higher than usual. "Absence of evidence" would be being in a windowless basement and not knowing how the whether is. You can't reason from "I'm in a basement" to "the train is probably not full". Øyhus seems to be claiming that "absence of evidence" implies being certain that the weather is dry).

0
On

If you would expect to notice something if it was there (like an elephant standing in your room), and you don't notice it, then that means it's probably not there (there's no elephant in your room).

3
On

If you read a bit on Oyhus' homepage, you can see that the impetus for this proof is at least partly as a response to statements like: "Even if there is no evidence for the existence of God, it does not mean God does not exist."

Strictly speaking, the proof isn't a response to this statement at all. The trick lies in a bit of the persuader's trade in blurring the distinction between "evidence for non-existence" and "proof of non-existence".

What's really shown in the proof is that lack of evidence for a claim makes it more likely the claim is false (i.e. evidence for non-existence). This is a far cry from being certain the claim is false (i.e. proof of non-existence).

1
On

An event A is called evidence for an event B if the latter is more likely in light of the former than in absence of the former. For example, upon discovery of my dead corpse one should consider the event "anon was murdered" more likely than if I were instead discovered breathing and happily typing away on my keyboard or, alternatively, I was not found at all (in which case I could still be quite alive but perhaps in hiding). Put this way, the saying does seem fairly tautological, but there are two common and very serious issues when actually trying to put it into play in the real world:

  • How much more probable "absence of event B" is in view of the absence of event A might be vanishingly small, and essentially moot in comparison to more significant information also available: you may not have discovered my corpse, which is technically evidence for my not being murdered by the mathematical definition, but if you also receive a video through the mail depicting my gruesome murder by the Joker, the lack of corpse is rendered meaningless.
  • Perhaps the event A doesn't actually meet the mathematical criteria of "evidence," but every-one's gut feeling is that it does: it may be perfectly consistent with B and easier to process along-side belief in B than belief in not-B. For example: dramatic stories that shine one's own country in a negative light might be considered less probable by the citizenry if there is a total absence of news reporting on the aforementioned stories (shouldn't we expect those stories to be disseminated in some fashion?) but this is fallacious reasoning because maybe there is a systemic reason for their being no reporting; perhaps news is being suppressed by national interests and so the assumption that reports are serious evidence is wrong.

Ultimately it boils down to information and perspective. Maybe we don't have the information necessary to make the most confident of judgments, in which case any calculation of probability is volatile in the sense that it could change quickly in light of Bayesian update through new (and not necessarily all that surprising) information. And maybe a lack of perspective clouds one's judgment, allowing one to think a hypothetical fact would be meaningful evidence when in fact the story could be rather more complicated, and basic observations superficially fulfill false preconceptions.

Addendum: As Henning points out, there is also an important difference between an actual absence of a particular form of evidence and merely not happening upon said evidence - if our probabilistic model refers to the former, then it won't be realistic because rarely can we check that no evidence is to be found anywhere (we aren't omniscient), whereas if it refers to the latter it is considerably weaker because we can't take $\neg A$ as an established fact but rather only as an educated guess.

Moreover, my bullet points and emphasis on perspective and information can be given a mathematical backing: even though the argument is sound and conclusion follows, it's also the case that more information can change the inequality the other way around:

$$P(\;\neg B\;|\;\neg\text{ evidence } A)>P(\;\neg B\;|\text{ evidence }A),\text{ but}$$ $$P(\;\neg B\;|\;\neg\text{ evidence } A,\text{ info }X)<P(\;\neg B\;|\text{ evidence }A,\text{ info }X).$$

We don't operate in a vacuum, so the possibility of additional information throwing off our calculations is real. More pointedly, one thing it does not establish is that $\neg B$ is more likely than $B$: in other words, even if $A$ is evidence for $B$ and its 'absence' is evidence for $\neg B$, it may very well be swamped by other facts so that $B$ is still likely to be true even if we're lacking the evidence $A$ for it, as in the example where others lack my corpse but it's still vastly more likely (in view of the video) that I was murdered (technically, I might have staged and edited it though..). Symbolically,

$$A\text{ evidence for }B\not\Rightarrow P(\neg B|\neg A)>P(B|\neg A).$$

All in all, taking this saying seriously in the real world is practically guaranteed to be hazardous without an accurate perspective and a much more in-depth understanding of context.