Precision & significant figure equality regarding decimal place?

55 Views Asked by At

Considering precision to the tenths place, where x is a non-zero integer, and the value has a tenths value of zero, Is there a precision difference between x and x.0 ?

Is one more accurate or mathematically correct?

Is this the same case for 0 vs 0.0?

1

There are 1 best solutions below

3
On BEST ANSWER

Yes, there is a difference. If it is not an exact value, $x$ has a tolerance of $\pm 0.5$ while $x.0$ has a tolerance of $\pm 0.05$. Either is correct if it properly represents your state of knowledge of the value. $x.0$ promises more accuracy, but it may be an empty promise. Certainly $x.0$ should convince you the author has thought about it, while $x$ may mean the author hasn't really thought about the precision with which $x$ is known, or it could mean that $x$ is an exact value. Yes, I would say it is the same for $0$ vs $0.0$.