Specifications
Resistor Range | Accuracy (95 %) (2 σ) Ratio 0.1 Through 10 | Applied Voltage |
10 kΩ to 10 kΩ | < 0.02 x 10-6 | 10 V to 20 V |
10 kΩ to 100 kΩ | < 0.1 x 10-6 | 10 V to 50 V |
100 kΩ to 1 MΩ | < 0.1 x 10-6 | 10 V to 110 V |
1 MΩ to 10 MΩ | < 0.1 x 10-6 | 10 V to 110 V |
10 MΩ to 100 MΩ | < 0.5 x 10-6 | 10 V to 110 V |
100 MΩ to 1 GΩ | < 5 x 10-6 | 10 V to 110 V |
Measurements Above 1 GΩ Require Special Resistor Configurations | ||
10 GΩ | < 20 x 10-6 | 10 V to 110 V |
100 GΩ | < 200 x 10-6 | 10 V to 110 V |
1 TΩ | < 500 x 10-6 | 10 V to 110 V |
Ratio 100:1 | < 2 x 10-6 | 10 to 110 V |
Ratio 1000:1 | < 20 x 10-6 | 10 to 110 V |
Note: Specifications are achievable with the resistors in MIL 9400A Oil Bath at 25 °C ± 20 m °C for 10 kΩ & 100 kΩ measurements and MIL 9300A Air Bath at 23 °C ± 10 m °C for 1 MΩ to 1 TΩ measurement. | ||
Linearity | 0.005 ppm | |
Short Term Drift (2 hours) Stabilization | < 0.2 ppm for 8 hours | |
Operating Environment | 18 to 34 °C, 10 to 80 % | |
Warranty | 1 Year Parts & Labour |