I'm sure your setup is relatively fast. With a drill, even faster. But if you get a Zip trim chuck and drill spindle and learn how to use it, I'm thinking it's fairly similar. So I agree, they are similar in speed, on the surface.
If you include the time for separately chamfering on the Wilson, I pretty sure that makes all the difference; the speed comparison falls apart. Even if you chamfer on a lathe, you still have to handle the cases a second time. Also, the Lee method takes seconds to setup and put away. And a caliber change is 10 seconds to swap the guide, or you can buy a dedicated cutter for each caliber and still be saving bank compared to a Wilson.
And it's easier to insert/remove the cases from the Zip. The major annoyance for me with the Wilson was the case holder. Having to turn it one way to tap cases out, and then turning it another to drop out the case, then turning it again to insert cases, then turning it back around to tap/tighten the case to make sure it doesn't spin instead of getting cut, this all takes a lot of movement that was tiring on my wrist... but that's another hill of beans. Sounds like your rod and hammer is a good idea!
I've seen some vids of very fast Wilson setups with Sinclar clamps and drill, but there's not really a good one for the Lee with a drill. Next time I prep 223, I'll try to remember to roll some film. I used to seriously wonder when I heard people claim they would trim all their brass with a Lee, because it was faster than sorting out and trimming just the ones that needed it. But after figuring out the deal, I'm getting closer to being on the same page. There a bit of an art to it, but it's surpringly effortless, once you get it down.