I enable the large voting buttons on both the full size and compact posts. I find I frequently will accidentally downvote a post when I am attempting to click through to the comments.
I think that when large voting buttons are turned on, it should disable being able to click on the vote tally area to vote on a post.
Thanks.
You're asking the wrong person. Maybe it's to leave the option for folks who switch hands but I'm not a UI designer, just offering you an easy solution to your problem (and not the one downvoting you).