There's a really quick fix here. All that needs to be done is remove the thumbs located below the main post, and also in the blog listings. That way, the only way to vote is to post a comment.