Instead of letting the deliveryman check the merchandise and decide what needs to be exchanged, have one of your employees do it before the delivery arrives.
Keep an inventory of everything that goes in and out of the store.
Again, check the quantities and weights of the merchandise exchanged.