Downvotes are used to show disagreement without an explanation which just stifles discussion, and for off-topic comments reporting them works as an alternative.

I do prefer user moderated conversations through downvotes but with the way they are used I don’t really trust us users enough for that.