Evangelical Protestants don't baptize infants and don't believe in baptismal regeneration, so there is no difficulty with consistency. When someone is baptized, nothing happens - it is only a public statement of faith.
Why should a church be forced to delete someone's name from a registry of people who were baptized? It's a historical event that happened whether the person likes it or not. It would be like asking the store to delete the sales record of a shirt you bought and don't wear any more.