Permission has been refused for homes on smallholding site over fears it could set a precedent of backland development.