Almost half of young adults with student loan debt say it is hindering them from buying a house, according to a survey by NeighborWorks America. While student loan debt can be a concern, another study shows that, for some, it isn't interfering with their home-buying plans at all.