In a world where there's so much pressure to be the right body shape, the right height, to wear the right clothes, have the perfect career, perfume remains a pleasure that is unique to you -- married to your memories and in constant interplay with a very personal aspect, the scent of your own body.
I don't stick to one perfume. Even if I rotate promiscuously, certain scents still do remind me of stressful or uncomfortable or downright painful moments, i.e. a serious, screaming quarrel. So the solution for me is not to get too attached to a single fragrance. Or go fragrance-free when I know I'll be going into something stressful, like a confrontation, so as not to have to deal with the memories afterwards.