Residents fear plans to build 170 new homes in Leeds will make their neighbourhood "'unrecognisable and poorer".