It's definitely not in my nature (nor do I consider it professional) to react aggressively to people who complain about my flying.
The worst incident I endured taught me a good lesson. I was flying in a neighborhood capturing photos and video of a small house. Near the end of the flight, I was in the owner's backyard. I was about to land when I heard a man's voice shouting at me from across the back fence - a few yards away. He was in a rage, shouting obscenities, telling me he was going beat the sh*t out of me and that he was going to shoot down my drone.
I yelled back that I'm landing it now, that we could talk, and I could explain what I was doing. He yelled back that it was too late, and he continued with the obscenities. By this time my hands were shaking from the adrenaline, and I was having a really hard time landing the drone. Finally, I did and went over to the man (who had cooled off a bit).
I explained that I was a real estate photographer and needed to fly around the neighborhood to get the shots I needed, and that I'm allowed by law to do that. He was still angry and explained to me that he was a Vietnam vet with PTSD and my drone was freaking him out. I apologized and told him that if I had known, then I wouldn't have flown over his house. I walked away feeling like sh*t.
The lesson I learned was that I need to be very sensitive to the possible negative experiences that drones can create. When a drone flies over someone's house, the person may be curious, suspicious, nervous, anxious, or angry. They probably do not understand the law, and may believe their privacy is invaded, their property is trespassed, and their family is at risk. It would be extremely callous of me to dismiss the reality of these reactions.
So, my approach is to minimize flying over peoples houses, to fly as high as possible, and to avoid hovering over the houses. I also do a number of other things to help communicate the law, to conduct myself in a professional and respectful way, and to ask the homeowners to point out any neighbors that might have a problem with the drone.