Nominal resolution
An n-bit converter distinguishes two to the power of n levels. The full vertical screen is divided among those levels, so the smallest step is the scale divided by that number. An instrument with more bits sees smaller changes at the same scale. Many general-purpose oscilloscopes use eight bits, and others offer more.
Effective bits
The nominal number of bits is a theoretical maximum. In a real instrument, noise from the input amplifier and the converter, nonlinear distortion and sampling clock uncertainty, or jitter, consume part of that resolution. Effective bits, known by the English acronym ENOB, are the number of bits of an ideal converter that would have the same signal-to-noise-and-distortion ratio. They are always fewer than the nominal bits, and they drop as the signal frequency increases.
What determines what you see
- Vertical scale: if the signal occupies a small fraction of the screen, only a few levels are used and resolution is lost. It is advisable to adjust the scale so that the signal occupies as much of the screen as possible without clipping.
- Instrument noise: at very sensitive scales, the instrument’s own noise is significant compared with the signal.
- Frequency: at high frequency, effective bits decrease because of jitter and the converter’s bandwidth.
How to improve it
- Use the whole screen vertically, with offset to center the signal.
- Apply averaging on repetitive signals, which reduces random noise and increases effective resolution.
- Use a high-resolution mode that averages consecutive samples with oversampling, at the cost of bandwidth.
- Choose an instrument with more bits when measuring small changes on top of a large level, such as the ripple of a power supply.
How to interpret the result
Visible stair-stepping of the signal indicates that few levels are being used. A trace that thickens as sensitivity increases is noise. No resolution improvement replaces a more accurate measurement with another instrument when low amplitude uncertainty is needed, because the oscilloscope is stronger on waveform than on absolute accuracy.