User manual - Chapter 2 Manual Calculations

19990401
2-1-2
Basic Calculations
*
1
Displayed values are rounded off to the place
you specify.
kk
kk
k Number of Decimal Places, Number of Significant Digits, Normal
Display Range
[SET UP]- [Display] -[Fix] / [Sci] / [Norm]
•Even after you specify the number of decimal places or the number of significant digits,
internal calculations are still performed using a 15-digit mantissa, and displayed values
are stored with a 10-digit mantissa. Use Rnd of the Numeric Calculation Menu (NUM)
(page 2-4-1) to round the displayed value off to the number of decimal place and
significant digit settings.
•Number of decimal place (Fix) and significant digit (Sci) settings normally remain in effect
until you change them or until you change the normal display range (Norm) setting.
Example 100 ÷ 6 = 16.66666666...
Condition Operation Display
100/6w 16.66666667
4 decimal places u3(SET UP) cccccccccc
*
1
1(Fix)ewiw 16.6667
5 significant digits u3(SET UP) cccccccccc
*
1
2(Sci)fwiw 1.6667E+01
Cancels specification u3(SET UP) cccccccccc
3(Norm)iw 16.66666667
20011101