Midrash sur Le Lévitique 5:26

8) Then I might say: Why (is there liability in) the case of the others? For (they treat of things that) do not damage (others) — as opposed to things that do damage, such as: one man's wounding another, a possession against a possession (e.g., one ox against anther), a man against a possession, a possession against a man. It is, therefore, written (to include liability in such instances) (Vayikra 5:22): "(and he swears falsely) in one of all these things that a man does to sin in them."