Informatika és tudomány

  • Bat
    #119
    Íme amit NV használ:
    Arithmetic operations can be performed at three different
    precisions. 32-bit floating point precision (fp32) uses the IEEE
    single-precision standard with a sign bit, 8 exponent bits, and 23
    mantissa bits. 16-bit floating-point precision (fp16) uses a similar
    floating-point representation, but with 5 exponent bits and 10
    mantissa bits. Additionally, many arithmetic operations can also be
    carried out at 12-bit fixed point precision (fx12), where values in
    the range [-2,+2) are represented as signed values with 10 fraction
    bits.