Yes, if you use the plug w/surplus ammo you'll have to close it (back it all the way out).
I've found that since this requires "lefty loosey" allen wrenching, it just unscrews the plug from the tube; probably better to just put a solid plug in for the surplus stuff than take it out, hold it in vise-grips, back it all the way out, put it back in, then have to allen wrench it down again (adjusting slowly for precision's sake).
I say adjust the plug for whatever commercial stuff you'll be using and leave it there, subbing the original solid plug for ammo that does not need special venting of excess pressure.