Stopping OS X prompting you for a keychain password

This happens when you change your login password. OS X can no longer decrypt the file it uses to store your passwords for things like websites etc.

To get rid of the password store (which will cause OS X to create a new one), open Terminal and do

rm ~/Library/Keychains/login.keychain-db