"Foreign" refers to the state of incorporation being different from the one who cares.
Florida (and every other state but Delaware) considers you to be a foreign corporation.
Delaware does not consider you to be a foreign corporation since you are incorporated there.
As you may have started to realize, if you have situs in Florida, even though you're a foreign corporation, you can still have tax liability there.