As a newer "prepper", I do not think you were foolish to try and hedge your bets on having some extra food stored away. Just look at the folks in NYC who superstorm Sandy did not destroy their homes or apartments but had no options because they had no simple extra's like canned goods, water, lighting or cash options that would have given them a little resiliancy. They were not likely threatened physically but were at the total mercy of the situation.
Perhaps you need to rethink what and how you are storing items. Maybe canned goods you can rotate with everyday use as they reach expiration dates, a simple propane stove, protective containers, and some water stored away would reduce your worry for the more likely possibilities and you can expand (if you want) from there.
Being a little prepared is better than nothing.

I've just thrown away like 8 bags of legumes and cereals (some 4kg in all), which I bought like 8 months ago as part of my deep pantry prepping. They were all infested with bugs. Clearly the supermarket and the food suppliers are better and more efficient at managing storage of food than I am.