All of the options under the Window menu are 'session specific', that is, when you quit out of the program the settings are not retained.
There is no way to have floaters to open up in the same place when you close a file and reopen it.
The settings will be retained if you set them up in a stationery or options file.