Residents say changing a single-family home's zoning could invite larger development and disrupt their community.