Federal law states for a handgun, you need to transfer it to an in-state person (resident, not just standing in front of you), and to whom you have no reason to believe is barred from owning it (under age, felon w/o rights, etc). You don't have to do a background check, just have no reason to believe them to be barred.
Some states have more heinous infringements on that, but they are well-known anti-gun places like NYC, etc. If you fellow state residents tell you there's no additional burden, then just go ahead.
There are fees for the FFL transfer, usually $20 to $60, unless you have a friend who does it for free.