To Blip or not to Blip

Took a photo of these lovely flowers on the way to the car after church. Just wondering if anyone else feels a little uncomfortable taking photos of people's front garden as you are walking by? It isn't lined up very well simply because I was trying to get the photo without anyone noticing. Cultural help here, please?