The whole point of a tax haven is that you don’t live there, you just incorporate your business there.  Tax havens are very small countries that have little else to offer, eg: Cayman Islands, Lichtenstein, Ireland, etc
I looked into it after starting my own business and it involves significant recurring costs and expensive accountancy services.  Not worth it for most.  The US tax code offers enough pro-business legislation as it is.
Some US states have less taxes in general but, as IroNat points out, that may come with its own disadvantages.