Much of the public facing information will still remain. For example, if you didn't create the Profile at all, but your business simply left a footprint on the Internet (merely by existing), Google would return any information it could about your business, anytime it was inclined, to the Public.