Specifications
| Resistor Range | Accuracy (95 %) (2 σ) Ratio 0.1 Through 10 |
Applied Voltage |
| 10 kΩ to 10 kΩ | < 0.02 x 10-6 | 10 V to 20 V |
| 10 kΩ to 100 kΩ | < 0.1 x 10-6 | 10 V to 50 V |
| 100 kΩ to 1 MΩ | < 0.1 x 10-6 | 10 V to 110 V |
| 1 MΩ to 10 MΩ | < 0.1 x 10-6 | 10 V to 110 V |
| 10 MΩ to 100 MΩ | < 0.5 x 10-6 | 10 V to 110 V |
| 100 MΩ to 1 GΩ | < 5 x 10-6 | 10 V to 110 V |
| Measurements Above 1 GΩ Require Special Resistor Configurations | ||
| 10 GΩ | < 20 x 10-6 | 10 V to 110 V |
| 100 GΩ | < 200 x 10-6 | 10 V to 110 V |
| 1 TΩ | < 500 x 10-6 | 10 V to 110 V |
| Ratio 100:1 | < 2 x 10-6 | 10 to 110 V |
| Ratio 1000:1 | < 20 x 10-6 | 10 to 110 V |
| Note: Specifications are achievable with the resistors in MIL 9400A Oil Bath at 25 °C ± 20 m °C for 10 kΩ & 100 kΩ measurements and MIL 9300A Air Bath at 23 °C ± 10 m °C for 1 MΩ to 1 TΩ measurement. | ||
| Linearity | 0.005 ppm | |
| Short Term Drift (2 hours) Stabilization | < 0.2 ppm for 8 hours | |
| Operating Environment | 18 to 34 °C, 10 to 80 % | |
| Warranty | 1 Year Parts & Labour | |