aperture sight

With peep sights, I've heard that moving one's eyes closer to, or farther from, the aperture will cause changes in elevation. This seems suspect based on my knowledge of how peep sights work, but I haven't been able to find any detailed information about this online so thought I'd ask here...