MATH
Login Or Sign up

List Question

15
704
Views

How to prove the bound for Relative Round Off error

Published on
#numerical-methods #floating-point #machine-precision
475
Views

Detect (catastrophic) cancellation in sums

Published on
#numerical-methods #computational-mathematics #floating-point
106
Views

Why Cardinality not the same for rounded floats?

Published on
#floating-point
90
Views

Prove that in a floating point system with truncation the number of significant digits is $n$.

Published on
#numerical-methods #floating-point #significant-figures
5.7k
Views

Adding two IEEE754 floating-point representations and interpreting the result.

Published on
#binary #floating-point
282
Views

Removable singularities for rational functions with floating point coefficients

Published on
#polynomials #gcd-and-lcm #rational-functions #floating-point
124
Views

Transform parabola to be tangent to line in point and through other point

Published on
#conic-sections #floating-point #tangent-line-method
3.1k
Views

How to compute amount of floating point operations for LU-decomposition of banded matrix?

Published on
#numerical-methods #gaussian-elimination #floating-point #sparse-matrices #lu-decomposition
2.2k
Views

How do we do arithmetic with negative floating point numbers?

Published on
#arithmetic #floating-point
518
Views

Why do harmonic series converge in a finite precision number system?

Published on
#numerical-methods #floating-point
520
Views

Numerical Accuracy: How many digits are correct?

Published on
#numerical-methods #floating-point
203
Views

46- and 64-bit integers

Published on
#computer-science #binary #computational-mathematics #floating-point
54
Views

Two's complement addition issue

Published on
#computer-science #binary #computational-mathematics #floating-point
350
Views

Double-precision algorithm for inverse log gamma or log factorial?

Published on
#approximation #factorial #gamma-function #inverse-function #floating-point
149
Views

Why is $0.0180 = 0.0180$ false in MATLAB?

Published on
#matlab #floating-point

Trending Questions

Popular # Hahtags

second-order-logic numerical-methods puzzle logic probability number-theory winding-number real-analysis integration calculus complex-analysis sequences-and-series proof-writing set-theory functions homotopy-theory elementary-number-theory ordinary-differential-equations circles derivatives game-theory definite-integrals elementary-set-theory limits multivariable-calculus geometry algebraic-number-theory proof-verification partial-derivative algebra-precalculus

Popular Questions

Copyright © 2021 JogjaFile Inc.