Different classes of vehicle that have significantly different speed capabilities should have separate lanes. Bikes, tractors, horse-drawn buggies; it's a safety hazard to force them to share a lane with automobiles.

I try to minimize the amount of time I'm in the wrong lane of traffic. If a car comes around the next corner while I'm passing, the cyclist is gonna be a lot more upset when I have to suddenly swerve back into the right lane. So I pass as quickly as possible. If he wants me to crawl past only doing a couple mph faster than he's doing, well, that's not gonna happen.

Also, if my car doesn't accelerate very fast, I need to get up to speed in order to pass. It's not just a quick little blip when I'm starting from 15 or 20 mph. So if it makes him nervous when my engine revs, maybe he shouldn't be riding a bike in traffic?

I can go slower if I stay in the correct lane, but that gives the bike less space. I can give the bike more space by going into the other lane, but then I'll have to go faster. Pick your poison. I'd be a jerk if I passed both close and fast. But either close or fast is a practical necessity, and if you get upset that I didn't do neither then you're the jerk.