Any amount of wind will shift the bullet to some degree, the question is how much is too much for your shooting needs.
A couple of tenths of an inch at 7 yards with a 10mph wind is probably within the amount of impact error for the average shooter, in other words, you wouldn't be able to tell if the wind, the ammo, or you were creating the impact error.
Remember, the error is directly related to how long the bullet is in flight. So a slower bullet will be effected more by the wind regardless of it's weight.
Oops, I forgot to mention that heavier bullets will tend to resist the effects of wind more than a lighter bullet but the longer the heavy bullet is in the air the more that same wind will effect it.