When I first read the OP I thought of the regulations as they apply to general aviation.
As a private pilot in a small airplane flying in a non-populated area, not taking off or landing, I am to stay at least 500 feet above the highest object on the ground, which could be a building or a tower...