Datasheet

Section 20 A/D Converter
Rev. 4.00 Sep 27, 2006 page 633 of 1130
REJ09B0327-0400
H'3FF
H'3FE
H'3FD
H'004
H'003
H'002
H'001
H'000
1
1024
2
1024
1023
1024
1022
1024
FS
Quantization error
Digital output
Ideal A/D conversion
characteristic
Analog
input voltage
Figure 20.9 A/D Conversion Precision Definitions (1)
FS
Offset error
Nonlinearity
error
Actual A/D conversion
characteristic
Analog
input voltage
Digital output
Ideal A/D conversion
characteristic
Full-scale error
Figure 20.10 A/D Conversion Precision Definitions (2)