and remember, Ned only walked away from that tower because Dayne was outnumbered 7 to 3.
5 of Ned's 7 people died while killing Daynes party of 3.
they cut Ned's dreams from the show, but here's what happened at the tower for anyone that wants to see/hear it:
http://youtu.be/v9Mp8MzAjAY