g. Problem:
This problem is when the result is the quotient of two
A resistor has 1.2 amperes 0.01% flowing through it when the
factors.
voltage across this resistor is 240 volts 0.05%.
What is the value of
this resistor and what is the maximum percentage of error in this
measurement?
10.
ERROR CALCULATION EXERCISES.
a. You are calibrating a 0.03% FS voltmeter using a stable variable
voltage source which you are monitoring with a 0.005% (of reading)
standard voltmeter. The TI is set to full scale, 10 volts, and the standard
reads 9.9958 volts.
(1) What is the percentage error of the test instrument?
(2) For this problem, you will use the following formula to arrive at
the percentage of error.
(3) Is the TI within tolerance?
The TI is out of the tolerance limit of 0.03% of the full-
(4) No.
scale reading.
b. The values and possible errors of two resistors are specified as
68.50 0.030 ohms and 14.30 0.020 ohms. Find the maximum possible
165