In most situations the calculation to return the result from binary to decimal for presentation purposes will remove any rounding error.
大多数情况下,为了显示,从二进制计算返回十进制结果会移除一些四舍五入误差。
Bugs fixed in the new version include: fix paste destination partition smaller than source, prevent visual disk display area from disappearing and fix minor cylinder alignment rounding error.
新版本修补了以往的漏洞:修正了数据在粘贴到目标分区后部分丢失的bug;防止可视磁盘显示区域消失;修复了较小磁道柱面调整的舍入误差。
By generalizing the above results, the paper estimates the rounding error of matrix basic calculation.
推广上述结果,对矩阵基本运算的舍入误差进行了估计。
This expression avoids rounding error brought by numerical integral method and complex calculation of Laplace transforms.
该转换表达式避免了数值积分法求解蠕变柔量值产生舍入误差和采用拉氏变换的繁琐计算。
To analyze the rounding error of calculator floating-point Numbers arithmetic operation is the foundation of numerical calculation method's error analysis.
对计算机浮点数算术运算的舍入误差进行分析,是对数值计算方法作误差分析的基础。
The condition of existence of solution and its algorithm are given, the rounding error of the solution process is analyzed and the convergence of the spline is proved.
文中给出了解存在的条件和解法,对解的舍人误差进行了分析,并证明了样条函数的收敛性。
When the code is compiled or interpreted, your "0.1" is already rounded to the nearest number in that format, which results in a small rounding error even before the calculation happens.
当代码被编译或者解释运行时,“0.1”已经被近似转化为这种形式下最接近的一个浮点数,这导致在计算还没有真正开始之前,一个微小的舍入误差就已经存在了。
First, the probabilistic model of the rounding error in the computation of quaternions on a fixed point computer is established. Then, the probabilistic rounding error estimates are computed.
首先,对于定点计算机上四元数计算的舍入误差建立了概率模型,然后对舍入误差进行概率估计。
First, the probabilistic model of the rounding error in the computation of quaternions on a fixed point computer is established. Then, the probabilistic rounding error estimates are computed.
首先,对于定点计算机上四元数计算的舍入误差建立了概率模型,然后对舍入误差进行概率估计。
应用推荐