In purely vertical feedback, only the boss learns; the subordinates merely follow orders. In purely horizontal feedback among peers, anyone can feedback to anyone; everyone learns. In reality, what happens is a mix of the two types.
An example applied to development projects:
It can happen that a project failed (project objectives were not met) yet it generated much useful knowledge, and vice versa.