Stick to your guns, figuratively and literally. I'm in somewhat the same situation in that I have liberal in-laws and family who'd wet their pants and generally freak if they knew I have and use a CCW, let alone all the goodies I keep locked up in my safe when they visit. I've found the best thing is to not change what I do (carry everywhere it's legal, whether or not they're around) and to be very matter of fact about it if somehow it comes up.
A couple of years ago it would have been a very Bad Scene if one of my liberal in-laws discovered that we have (and use) arms, my wife would have been very upset with me too and would have expected me to back down. However, 6 months ago she got her own CWP and her own .38, and she now sees things much the way I do and carries regularly herself (and is a better shot than I am). If hysterical anti-gun people encounter an armed person such as yourself, I think being matter of fact and unapologetic about carrying and owning/enjoying firearms is the best tack. Saying "i'm sorry I upset you" lends credence to their emotional dislike of firearms. Seeing firearms carried routinely and without incident has the best chance of getting one of them to see the light, and to see that us CCW'ers don't run around itching to get into a gunfight with someone.
Side note - I reload also, and my reloading press and working area in our garage makes quite the ice-breaker with people when we show them around. "what is that thing, a chemistry set?" "Well, sort of, it's actually a reloading press" "What's that?" and so forth.