I would focus less on the metrics. Let people follow each other because of the content, not the social approval. You can always hide the numbers behind a click, if you still want to keep them visible.