In my opinion as someone who speaks BrE - 'gone' is only really used with I've because it makes the person the subject of the sentence. With I haven't the subject is the action of going to the store therefore in BrE you would say "I haven't been to the store"

Disclaimer : I came to this conclusion from being a native English speaker and picking up differences whilst learning foreign languages so don't take it as fact!