We've been kind of lucky on this front. Comet/small asteroid impacts in historical times have taken place in remote locations, particularly Siberia. A comet or especially an asteroid striking in a heavily populated area could be disastrous. One would hope so. Forest fires are integral to the health of the forest.