I'm team "ship-to-customer" overhead hurts and it is hard to control or predict when you have to store product or hold inventory. If the area is booming it could come to a halt and you would be stuck trying to get rid of material and covering your overhead expenses.
If the area is truly gentrified the end consumer isn't always concerned with price, they will likely give preference to the easiest supplier, best option for their tastes, or sustainablility. Is the shipping going to hold up the building process? Is the material of the same quality as something they more readily have access to? Without knowing the wall material/competition/demographic you are serving it is hard to make an accurate observation.