This is a quick plug for an excellent article I came across, that explains how computer systems deal with floating point operations and all that happens under the hood for precision.
It is lengthy and parts of it might twist your neurons, but I highly recommend giving it a glance at least: http://docs.sun.com/source/806-3568/ncg_goldberg.html