Water contains charged ions and impurities that make it a very good conductor of electricity.
The properties of rubber (eraser) causes the electrons to slow down and eventually prevent them from moving at all. Keeping electricity bound within the material is the main goal of an insulator.