In Internet Explorer, click "Tools/Internet Options" in the menu bar
In the General Tab click "Settings" in the Browsing History section
You will now have the Window in the right of the above pic displayed
Just set your settings to the same as mine in that pic and you should be right, bear in mind that I am using Internet Explorer 7 so the windows you get could look a little different but the options and settings will be the same.