The challenge of stopping drone swarms

Drones have been flying over critical civilian and military sites around the United States for years. Why is it so hard for the military to stop them?