MATH
Login Or Sign up

List Question

15
6.2k
Views

Explain why catastrophic cancellation happens

Published on
#numerical-methods #floating-point #catastrophic-cancellation
22.6k
Views

How to convert from floating point binary to decimal in half precision(16 bits)?

Published on
#binary #floating-point
23.3k
Views

Convert hexadecimal numbers to floating-point format using single-precision IEEE 754 format

Published on
#binary #floating-point
40
Views

Storing a real matrix - fl notation

Published on
#matrices #real-numbers #floating-point
949
Views

How to calculate the inverse of sum of a Kronecker product and a diagonal matrix

Published on
#inverse #computational-complexity #diagonalization #floating-point #kronecker-product
132
Views

Precision and Accuracy

Published on
#floating-point
307
Views

Why do I get a big relative error for my function? (Numerical Analisys - floating point)

Published on
#numerical-methods #floating-point
70
Views

Audio frequency increment yielding wrong results

Published on
#exponentiation #floating-point
10.2k
Views

Floating point number,Mantissa,Exponent

Published on
#floating-point
60
Views

approximation using floating point arithmetic

Published on
#approximation #floating-point
1.2k
Views

Simplifying a decimal number under modular arithmetic – $9.9 \pmod{13}$

Published on
#elementary-number-theory #modular-arithmetic #floating-point
132
Views

Name of function $(1+x)^n-1$

Published on
#numerical-methods #terminology #special-functions #floating-point
245
Views

Can trigonometric functions for double precision be implemented in terms of those for single precision?

Published on
#trigonometry #numerical-methods #approximation #floating-point
2.5k
Views

why is $2.2250738585072014\text{e}{-308}$ not a number?

Published on
#computer-science #exponentiation #floating-point
1.6k
Views

IEEE-754 Format Conversion

Published on
#arithmetic #binary #floating-point

Trending Questions

Popular # Hahtags

second-order-logic numerical-methods puzzle logic probability number-theory winding-number real-analysis integration calculus complex-analysis sequences-and-series proof-writing set-theory functions homotopy-theory elementary-number-theory ordinary-differential-equations circles derivatives game-theory definite-integrals elementary-set-theory limits multivariable-calculus geometry algebraic-number-theory proof-verification partial-derivative algebra-precalculus

Popular Questions

Copyright © 2021 JogjaFile Inc.