It is all bad. Loud car stereos, head banging house stereos, firearms, fireworks, ijots with straight pipes on their motorcycles, loud farm machinery, dragsters, etc.
Many muzzle loader target/match shooters use minimal charges to get the job done. Not as loud, but still damaging over time, even without the loud crack.
Had a friend that worked in the syrup dept at a Chocolate company loading the empty clean cans into the production machinery. The rattle and banging of the empty cans didn't seem loud when I worked with him for a week. After 5 years, he realized his hearing loss and started wearing protection but it was too late.
I almost always wore ear plugs/muffs and I still came out tone deaf to certain levels of sound. Very low tones are next to impossible for me to notice. A neighbor down the street has a very very low voice. Unless I see his face to be able to read his lips, I can't figure out what he is saying.