Put the "Follow You" check back on. From what you are describing, all you need to do is put your mouse over Carbonites map, it will fade into view and you'll be able to see a small checkbox in the upper right corner. Un tick that box only. It's used for Auto Scale.
As a note, you may only be able to see the checkbox when you are looking at the minimized Carb Map.
Enjoy
