The whole point of a tax haven is that you don’t live there, you just incorporate your business there. Tax havens are very small countries that have little else to offer, eg: Cayman Islands, Lichtenstein, Ireland, etc
I looked into it after starting my own business and it involves significant recurring costs and expensive accountancy services. Not worth it for most. The US tax code offers enough pro-business legislation as it is.
Some US states have less taxes in general but, as IroNat points out, that may come with its own disadvantages.