Well glockman19, with regard to California, you're wrong about knives. It's a felony to carry a fixed blade knife concealed. It's completely legal to carry a folding knife, other than a switch blade, balisong or "flick" knife, concealed, of any size, as long as it is folded. The clip doesn't mean a thing.
As far as carrying a concealed gun being only a misdemeanor, a misdemeanor is not the same as a traffic ticket. You are subject to arrest, being taken to jail, booked and waiting in a cell until you can make bail. You can go to jail for up to a year. If you have a clean record, you probably can avoid going to jail by making a plea deal. As part of any plea bargain, you will probably have to agree to a period of probabtion (during which time your 4th Amendment rights are suspended) and you will also have to give up your guns, and you will not be able to legally buy more.
One may probably expect a similar result in many other states.
Laws prohibiting carry guns without permits are valid and enforceable unless and until a court tosses them out. If you are caught, you will pay whatever penalty is applicable unless you can mount a successful defense, based on the 2nd Amendment or otherwise. If you want to challenge such a law, be my guest; but I hope you have several million dollars lying around. The legal bill in Heller was around $3.5 Million, IIRC.
Oh, and courts have generally recognized that Constitutionally protected rights can be subject to limited regulation. I suspect that it is highly unlikely that a court would throw out a "shall issue" permit law. But if you've got the money, take your best shot.