cache memory

I have been told that you really should think about improving your cache size........In all reality what does this do and should I consider doing it?

You can do it by buying a new processor, harddrive, SCSI controller, optical drive or whatever component is in question.