MATH
Login Or Sign up

List Question

15
246
Views

Solving strict inequalities with integer maths accounting for rounding errors

Published on
#floating-point #machine-precision
32
Views

Is roundDown(roundDown(x/n)/n) = roundDown(x/n²)?

Published on
#floating-point #rounding-error
66
Views

How can I estimate the exponent of the Floating Point Arithmetic representation of a decimal number?

Published on
#numerical-methods #floating-point
140
Views

How does the machine round in floating point arithmetic?

Published on
#reference-request #numerical-methods #floating-point #rounding-error #rounding-unit
429
Views

Sexagesimal Reciprocals - Confused About Floating Point Reciprocals

Published on
#algebra-precalculus #divisibility #floating-point
1.1k
Views

Last added floating point term of harmonic series

Published on
#sequences-and-series #floating-point
2.4k
Views

Floating point representation in 8 bit

Published on
#numerical-methods #floating-point
341
Views

Using Groebner basis

Published on
#polynomials #numerical-methods #systems-of-equations #roots #floating-point
1k
Views

How to represent the decimal value $- 7.5$ as a floating point number?

Published on
#floating-point #computer-arithmetic
2.1k
Views

Why does floating point numbers have uneven spacing on the number line?

Published on
#floating-point #rounding-error #number-line
436
Views

Why is MATLAB displaying 1.0000 when I do 1+eps?

Published on
#matlab #floating-point
514
Views

Taylor's series error or floating point error?

Published on
#taylor-expansion #matlab #floating-point
163
Views

How can I show that $3\times2^{-53} = 2^{-52}+2^{-53}$?

Published on
#numerical-methods #binary-operations #floating-point
8.4k
Views

Converting from 16 Bit Floating Point Binary to Decimal

Published on
#binary #floating-point
1.5k
Views

Encoding a floating point value

Published on
#binary #binary-operations #floating-point

Trending Questions

Popular # Hahtags

second-order-logic numerical-methods puzzle logic probability number-theory winding-number real-analysis integration calculus complex-analysis sequences-and-series proof-writing set-theory functions homotopy-theory elementary-number-theory ordinary-differential-equations circles derivatives game-theory definite-integrals elementary-set-theory limits multivariable-calculus geometry algebraic-number-theory proof-verification partial-derivative algebra-precalculus

Popular Questions

Copyright © 2021 JogjaFile Inc.