Question Regarding Caching

Ok so i'm a little confused regarding this whole caching subject.  I have WP Super cache installed because it's been recommended but I'm not sure what to do with it. My issue is that I keep having to delete the cache to see any changes I make on my website.  9/10 I make a change and it is not reflected on the front end of my website until I clear the cache. So what is the issue here?  is that normal or are there certain caching guidelines i need to follow. I've been told by support here once that my website has caching issues and that i should do a server cache reset or something like that which I don't know how to do. Thank you.