Councils have strict rules regarding what a block of land can be used for (residential, commercial, industrial). If the block next door could potentially develop into a warehouse or 5 story apartment building it might not be the best option for your quiet retreat away from home. You’ll also want to make sure there’s no plans to build a highway or other infrastructure through your land or the nearby area.