Jim Boykin has a great post about link co-citations, and how search engines use that to help determine your site’s relevance to certain keywords. This is probably the clearest explanation on why you want on-topic links more than anything else.
EBLOG
E-Marketing Performance Blog