There is certainly truth to this. My wife sat on a local board and the staff (with whom she had cordial relations) were frank about saying "we'll be here when you're gone."
Holder is a hard core left wing ideologue. He says things that the President doesn't agree with, or at least, doesn't want him to say out loud. He was told to shut up about guns back in the first year of the Obama presidency, and he may be told again. He also seems to be a mediocre administrator at best.