One type of electronic noise that is inescapable is Johnson-Nyquist noise. Roughly a hundred years ago, physicists studying electricity noticed that sensitive measurements showed noise (apparently random time-varying fluctuations in the voltage or current). They found that the power spectral density of (for example) the voltage noise, SV, was larger when the system in question was more resistive, and that higher temperatures seemed to make the problem even worse. Bert Johnson, then at Bell Labs, did a very careful study of this phenomenon in 1927, and showed that this noise appeared to result from statistical fluctuations in the electron "gas". This allowed him to do systematic measurements (with different resistances at fixed temperature, and a fixed resistance at varying temperatures) and determine Boltzmann's constant (though he ends up off by ~ 10% or so). Read the original paper if you want to get a good look at how a careful experimentalist worked eighty years ago.
Very shortly thereafter, Harry Nyquist came up with a very elegant explanation for the precise magnitude of the noise. Imagine a resistor, and think of the electrons in that resistor as a gas at some temperature, T. All the time the electrons are bopping around; at one instant there might be an excess of electrons at one end of the resistor, while later there might be a deficit. This all averages out, since the resistor is overall neutral, but in an open circuit configuration these fluctuations would lead to a fluctuating voltage across the resistor. Nyquist said, imagine a 1d electromagnetic cavity (transmission line), terminated at each end by such a resistor. If the whole system is in thermal equilibrium, we can figure out the energy content of the modes (of various frequencies) of the cavity - it's the black body radiation problem that we know how to solve. Now, any energy in the cavity must come from these fluctuations in the resistors. On the other hand, since the whole system is in steady state and no energy is building up anywhere, the energy in the cavity is also being absorbed by the resistors. This is an example of what we now call the fluctuation-dissipation theorem: the fluctuations (open-circuit voltage or short-circuit current) in the circuit are proportional to how dissipative the circuit is (the resistance). Nyquist ran the numbers and found the result we now take for granted. For open-circuit voltage fluctuations, SV = 4 kBTR V2/Hz, independent of frequency (ignoring quantum effects). For short-circuit current fluctuations, SI = 4 kBT / R A2/Hz.
Johnson-Nyquist noise is an unavoidable consequence of thermodynamic equilibrium. It's a reason many people cool their amplifiers or measurement electronics. It can also be useful. Noise thermometry (here, for example) has become an excellent way of measuring the electronic temperature in many experiments.