No problem at all.
Are these stock transfers with a single company code or intra-company? Not sure it will make a difference but if they are intra-company check if you have vendors assigned to the storage locations.
Either way I think you would need a BAdI implementation to enforce the single issuing storage location rule and set the address to the value you require. ME_PROCESS_PO_CUST would probably support both requirements but you would need to confirm with an ABAPer.