Accuracy, resolution, range, counts, digits and precision

Keeping your world up and running.®

×

Accuracy, resolution, range, counts, digits and precision

 

Accuracy: An instrument’s degree of veracity—how close its measurement comes to the actual or reference value of the signal being measured.

Resolution: The smallest increment an instrument can detect and display—hundredths, thousandths, millionths.

Range: The upper and lower limits an instrument can measure a value or signal such as amps, volts and ohms.

Precision: An instrument’s degree of repeatability—how reliably it can reproduce the same measurement over and over.

Click the individual tabs above to read more in-depth explanations of these terms as well as counts and digits.

Was this helpful?
Yes
No
Recommended Products
Recommended Resources
 
©2016 Fluke Corporation. Specifications subject to change without notice. 6004532